-- Logs begin at Wed 2022-08-24 04:46:11 UTC, end at Wed 2022-08-24 05:59:02 UTC. -- Aug 24 05:17:46.704121 dv-cinder-854267-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 05:17:46.716443 dv-cinder-854267-1-smb devstack@keystone.service[81627]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:17:46 2022] *** Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: nodename: dv-cinder-854267-1-smb Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: machine: x86_64 Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: clock source: unix Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: pcre jit disabled Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: detected number of CPU cores: 4 Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: current working directory: / Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:17:46.718503 dv-cinder-854267-1-smb devstack@keystone.service[81627]: your processes number limit is 47680 Aug 24 05:17:46.719307 dv-cinder-854267-1-smb devstack@keystone.service[81627]: your memory page size is 4096 bytes Aug 24 05:17:46.719307 dv-cinder-854267-1-smb devstack@keystone.service[81627]: detected max file descriptor number: 2048 Aug 24 05:17:46.719307 dv-cinder-854267-1-smb devstack@keystone.service[81627]: lock engine: pthread robust mutexes Aug 24 05:17:46.719307 dv-cinder-854267-1-smb devstack@keystone.service[81627]: thunder lock: enabled Aug 24 05:17:46.719307 dv-cinder-854267-1-smb devstack@keystone.service[81627]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 05:17:46.719307 dv-cinder-854267-1-smb devstack@keystone.service[81627]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:17:46.757951 dv-cinder-854267-1-smb devstack@keystone.service[81627]: Python main interpreter initialized at 0x555cd7d609c0 Aug 24 05:17:46.757951 dv-cinder-854267-1-smb devstack@keystone.service[81627]: python threads support enabled Aug 24 05:17:46.757951 dv-cinder-854267-1-smb devstack@keystone.service[81627]: your server socket listen backlog is limited to 100 connections Aug 24 05:17:46.757951 dv-cinder-854267-1-smb devstack@keystone.service[81627]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:17:46.758355 dv-cinder-854267-1-smb devstack@keystone.service[81627]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:17:46.758440 dv-cinder-854267-1-smb devstack@keystone.service[81627]: *** Operational MODE: preforking *** Aug 24 05:17:46.758737 dv-cinder-854267-1-smb devstack@keystone.service[81627]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:17:46.758737 dv-cinder-854267-1-smb devstack@keystone.service[81627]: spawned uWSGI master process (pid: 81627) Aug 24 05:17:46.758942 dv-cinder-854267-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 05:17:46.760514 dv-cinder-854267-1-smb devstack@keystone.service[81627]: spawned uWSGI worker 1 (pid: 81641, cores: 1) Aug 24 05:17:46.760514 dv-cinder-854267-1-smb devstack@keystone.service[81627]: spawned uWSGI worker 2 (pid: 81642, cores: 1) Aug 24 05:17:46.760514 dv-cinder-854267-1-smb devstack@keystone.service[81627]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:17:51.171591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:17:51.171591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: from cryptography.utils import int_from_bytes Aug 24 05:17:51.172403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:17:51.172403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: from cryptography.utils import int_from_bytes Aug 24 05:17:51.172867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:17:51.172867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: from cryptography.utils import int_from_bytes Aug 24 05:17:51.173333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:17:51.173333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: from cryptography.utils import int_from_bytes Aug 24 05:17:51.230899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:17:51.231086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:17:51.231183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:17:51.231269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:17:51.231337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] command line args: [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:17:51.231401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] command line args: [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:17:51.231548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:17:51.231641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:17:51.231709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ================================================================================ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:17:51.231812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ================================================================================ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:17:51.231944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] admin_token = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] admin_token = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_dir = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config_dir = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_source = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config_source = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] debug = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] debug = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.232943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.233934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.234049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.234216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.234379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.234545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_config_append = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.234769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_config_append = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.234955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.235151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.235330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_dir = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.235501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_dir = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.235671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.235808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.235910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.236961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.237933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.238998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.239923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.240116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] publish_errors = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.240320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] publish_errors = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.240494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.240686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.240876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.241074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.241330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.241523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.241715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.241925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] standard_threads = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] standard_threads = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.242905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_journal = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_journal = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_json = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_json = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_stderr = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_stderr = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.243971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_syslog = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.244083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_syslog = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.244193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.244312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:17:51.244312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.244312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.244312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.244796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.245096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.245295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.245493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.246177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.246360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.246542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.246760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.246938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.247963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.248964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.249910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.250955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.251956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.252958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.253977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.254902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.255887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.256959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.257960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.258952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.259885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.260904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.261025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.261025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.261235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.261947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.262061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.262061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.262710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.262831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.262955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.263993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.264989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.265922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.266904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.267958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.268997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269690 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.269924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.270876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.external = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.external = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.271946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.password = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.token = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.password = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.272892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273005 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.token = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.273939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.274926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.275913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.276958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.277957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.278990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.279919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.280963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.281992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.282929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.283984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.284899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285693 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.285928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.286893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287708 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.287936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.288983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289212 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.289901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.290970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.291898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.292010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.292124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.292246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.292361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.292475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.293998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.294992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.295796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.296932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.297980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.298901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.299902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.300928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.301920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.302968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.303944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.304979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.305904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.306919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.307935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.308049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.308164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.308892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.309893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.310936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.311947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.312987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.313898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.314956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315298 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.315995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.316896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.317983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.318996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.319925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.320913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.321939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.322053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.322166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.322279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:17:51.322393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.322393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:17:51.322393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:17:51.347845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.348074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.348156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.348283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.348366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.348515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.357703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.357815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.386653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.386852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.386926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.387130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.441472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.441640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.491752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.491984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.492176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.492414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.655744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.655975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.656931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.657103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.657324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.657542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.680434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.680667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.680896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.681996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.682213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.682428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.693784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.694532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.706941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.707909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.708035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.708116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.708245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.708326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:17:51.725620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.725829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:17:51.726012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.726172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.726258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:17:51.726374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:17:51.726556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.726641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.726783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:17:51.726924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.727063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.727329 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.727445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.727708 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.727845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.728111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.737345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.737628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.737715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.737898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.737984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.738167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.738259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.738451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.745192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.745516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.749023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.749123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.749312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.749396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.749602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.749685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.749886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.749977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.750172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.750254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.750433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.750515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.750712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.750798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.751943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.752022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.775030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.775192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.776516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.776601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.776805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.777406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.782017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.782115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.782304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.782388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.782583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.782666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.788938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.789034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.789228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.789310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.793490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.793598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.793782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.793867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.794946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.795029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.795216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.795300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.795485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.795568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.813415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.813577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.813703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.813788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.817611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.817704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.820852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.820942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.821161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.821245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.825432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.825615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.828606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.828746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.831838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.832925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.833017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.833207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.833291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.833503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.849609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.849892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.850059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.850150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.850353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.850447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.850622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.850930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.857476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.858100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.859667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.859948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.862675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.862990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.863107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.863285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.863387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.863579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.863861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.866068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.866427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.866780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.867066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.867355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.876213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.876518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.876808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.877094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.877378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.877658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.877938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.879592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.879901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.880189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.880472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.880751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.881037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.881312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.899363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.899715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.903119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.903931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.906166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.907040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.907888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.908652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.909380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.909670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.909966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.910116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.910421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.910719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.916519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.917210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.918736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.919357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.921679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.921976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.922258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.922345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.922553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.922635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.922873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.923161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.930620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.930950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.931155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.931238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.931457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.931743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.938927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.939218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.939308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:17:51.939500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.939583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.939779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.939864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.940972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.941961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.942039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.942233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.942312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.942502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.942582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.942787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:17:51.977434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555cd7d609c0 pid: 81642 (default app) Aug 24 05:17:51.977900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555cd7d609c0 pid: 81641 (default app) Aug 24 05:17:51.981167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196c1b-cbc3-4a0e-9323-1ce9ffb326ae None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:17:51.981454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196c1b-cbc3-4a0e-9323-1ce9ffb326ae None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:17:51.981730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196c1b-cbc3-4a0e-9323-1ce9ffb326ae None None] PATH_INFO: `/v3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:17:51.985868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Aug 24 05:17:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:17:59.610604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:17:59.611099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:17:59.611183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:17:59.615425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:17:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:17:59.623410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:17:59.623838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:17:59.623961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:17:59.701406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: INFO dbcounter [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] Registered counter for database keystone Aug 24 05:17:59.720912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG oslo_db.sqlalchemy.engines [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:17:59.727163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writer thread running {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:17:59.912272 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG passlib.handlers.bcrypt [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81642) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 05:17:59.912601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG passlib.handlers.bcrypt [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81642) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 05:17:59.967672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:17:59.969284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:00.105331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:17:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 05:18:00.561262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:00.636925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: INFO dbcounter [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] Registered counter for database keystone Aug 24 05:18:00.660878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG oslo_db.sqlalchemy.engines [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:18:00.667802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writer thread running {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:18:00.788440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417b4a8-75a5-449d-a64e-0a521958e217 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:00.794144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:00.794825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:00.795116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:00.795396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:00.808261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:00.859605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING keystone.common.rbac_enforcer.enforcer [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 05:18:00.859887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42965-435a-4af1-945c-1709a20f7367 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:00.869818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Aug 24 05:18:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:18:00.876454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:00.891691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741603f7-ef74-4c32-a9ec-c933ce9dc1b6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:00.896234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:00.897344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:00.897628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:00.897898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] PATH_INFO: `/v3/projects/bbd4e8f6f06741eca1091b51da45521e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:00.899496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] RBAC: Authorizing `identity:get_project(project_id=bbd4e8f6f06741eca1091b51da45521e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:00.952355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 05:18:00.952699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448ad29-524d-4fbf-976a-147dc9158f44 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:00.957312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Aug 24 05:18:00 2022] GET /identity/v3/projects/bbd4e8f6f06741eca1091b51da45521e => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:02.856397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6943-0fa4-469e-b5a5-fee19469c627 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:02.856907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6943-0fa4-469e-b5a5-fee19469c627 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:02.856907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6943-0fa4-469e-b5a5-fee19469c627 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:02.860947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:02.866521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:02.866975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:02.867101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:02.887999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:02.889537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:02.897337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 05:18:03.169052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6943-0fa4-469e-b5a5-fee19469c627 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:03.181768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6943-0fa4-469e-b5a5-fee19469c627 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:03.186920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c22c5-7169-4e64-9dd8-94f46c0b3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:03.187538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c22c5-7169-4e64-9dd8-94f46c0b3f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:03.187823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c22c5-7169-4e64-9dd8-94f46c0b3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:03.188101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c22c5-7169-4e64-9dd8-94f46c0b3f96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:03.196152 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c22c5-7169-4e64-9dd8-94f46c0b3f96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:03.197938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c22c5-7169-4e64-9dd8-94f46c0b3f96 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:03.207605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Aug 24 05:18:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:18:03.213550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:03.223459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9006e-19eb-4d6b-9139-5752de77bdc2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:03.228059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46655a0-b60c-403e-ac55-f7807ee4a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:03.228761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46655a0-b60c-403e-ac55-f7807ee4a0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:03.229043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46655a0-b60c-403e-ac55-f7807ee4a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:03.229318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46655a0-b60c-403e-ac55-f7807ee4a0a7 admin admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:03.231365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46655a0-b60c-403e-ac55-f7807ee4a0a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:03.233397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46655a0-b60c-403e-ac55-f7807ee4a0a7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:03.235021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Aug 24 05:18:03 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:05.294990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bbd1f-583c-443a-905b-67f19a857c6e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:05.295571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bbd1f-583c-443a-905b-67f19a857c6e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:05.295571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bbd1f-583c-443a-905b-67f19a857c6e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:05.297120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:05.303019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:05.303508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:05.303687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:05.326744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:05.327947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:05.351076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d99b9-ce77-4496-9b63-08a855238d71 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:05.351451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d99b9-ce77-4496-9b63-08a855238d71 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:05.351733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d99b9-ce77-4496-9b63-08a855238d71 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:05.353533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:05.360632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:05.360920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:05.361195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:05.408403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG passlib.handlers.bcrypt [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81641) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 05:18:05.408932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG passlib.handlers.bcrypt [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81641) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 05:18:05.422411 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:05.455062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:05.456706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:05.566070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:05.705632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:05.731432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:05.818020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb48-ac0b-4973-bd71-c2de572d05b3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:05.841363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:05.853443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:05.854552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:05.854552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:05.854854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:05.868506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:05.877727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:05.878821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:05.879649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:05.884729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:05.956330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb5b6-5d3c-4cd2-bae5-4baedbc0c0bd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:05.958735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:05.984426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:05.997066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:05.997944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:05.998515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:05.998515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.004107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1d57-173a-4b25-b5b8-9b4a3dc1aa45 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:06.046970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:06.047776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:06.048156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:06.048487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.049317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:06.049665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.051523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.066260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:06.072008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:06.074145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.075752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.184346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53eff-4f4a-48bb-b899-1f3d0d14c90d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:06.190466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:06.196414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:06.200944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:06.228403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:06.229052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:06.229346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:06.230261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.231532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.233018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.234623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:06 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:06.240413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:06.256647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:06.308743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b2d6-6e0b-4a9c-a7bd-3897c93ff884 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:06.351042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:06.351827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:06.352105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:06.352377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.353636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0111b2-3b81-429f-94aa-2d587208e0d1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:06.374967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.376453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.392521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:06.393160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:06.393440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:06.393710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.394874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.396999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:18:06.397119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:06.398115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:18:06.398936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:18:06.398936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:18:06.398936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:06.399105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:06.399780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:06.404926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:06.405093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:06.467664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:06.495735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:06.518348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bfc65-e3f0-4255-b65b-0c4e77b54c15 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:06.519041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e23912-a5a9-437d-8833-c2be09ba59b8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:06.554825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:06.555443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:06.555725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:06.555998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.556653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:06.556956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.559443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73013b70-15c3-4536-a677-420c8a842ee5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.559755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:06.560366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:06.560645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:06.560919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:06.561708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.domain.id=default, user.id=e8573ad460824b098e5067d101527da0) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:06.562013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:06.563498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ed7e-1858-499c-9cc1-66f3ef5fff63 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:06.570680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Aug 24 05:18:06 2022] GET /identity/v3/role_assignments?user.id=e8573ad460824b098e5067d101527da0&scope.domain.id=default&role.id=afa0ce309d704597adab4050e9d32d4d => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:06.579628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:08.825878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9dc0-caf2-48af-bcbd-cc2da0e16eff None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:08.826929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9dc0-caf2-48af-bcbd-cc2da0e16eff None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:08.827439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9dc0-caf2-48af-bcbd-cc2da0e16eff None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:08.829356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:08.835039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c966acd-fe62-4d4a-a6f8-2f48f650f00f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:08.835922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c966acd-fe62-4d4a-a6f8-2f48f650f00f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:08.836396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c966acd-fe62-4d4a-a6f8-2f48f650f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:08.857330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9c966acd-fe62-4d4a-a6f8-2f48f650f00f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:08.858891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9c966acd-fe62-4d4a-a6f8-2f48f650f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:08.891843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cff0b-2d09-40ba-a08f-f2eada7c1517 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:08.892502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cff0b-2d09-40ba-a08f-f2eada7c1517 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:08.892982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cff0b-2d09-40ba-a08f-f2eada7c1517 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:08.894827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:08.912702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121cc5c-756d-4b19-bd64-330f0e70f9eb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:08.913305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121cc5c-756d-4b19-bd64-330f0e70f9eb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:08.913813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121cc5c-756d-4b19-bd64-330f0e70f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:08.959729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5121cc5c-756d-4b19-bd64-330f0e70f9eb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:08.961332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5121cc5c-756d-4b19-bd64-330f0e70f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:08.970220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:09.076864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:09.193548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde486d-96e1-481e-bb57-cd3fd049ec60 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:09.193833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde486d-96e1-481e-bb57-cd3fd049ec60 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:09.194027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde486d-96e1-481e-bb57-cd3fd049ec60 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:09.195673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 12/26] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:09.201119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:09.201656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:09.202178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:09.230670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:09.232216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:09.338324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:09.483368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde486d-96e1-481e-bb57-cd3fd049ec60 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:09.516325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:09.521152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:09.582978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:09.705672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde486d-96e1-481e-bb57-cd3fd049ec60 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:09.724240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed753a-224e-4303-b01a-8d490e3f5ab5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:09.772811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:09.773377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:09.773660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:09.773935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:09.789712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:09.791227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:09.802027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71aafd-e295-4119-9be8-41f29d13fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:09.802677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71aafd-e295-4119-9be8-41f29d13fc69 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:09.802981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71aafd-e295-4119-9be8-41f29d13fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:09.803258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71aafd-e295-4119-9be8-41f29d13fc69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ad460a5e-61c6-4d0d-95fd-83fe7ac81110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:18:09.817795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:09.818684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:18:09.819522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:18:09.819522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:18:09.819522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:09.819522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 13/28] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:09.820320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518acea2-df7d-4995-914e-0f1f00767ac9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:09.820494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518acea2-df7d-4995-914e-0f1f00767ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:09.820722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518acea2-df7d-4995-914e-0f1f00767ac9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:09.827331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 14/29] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:09.827496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71aafd-e295-4119-9be8-41f29d13fc69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:09.832288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518acea2-df7d-4995-914e-0f1f00767ac9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cb71aafd-e295-4119-9be8-41f29d13fc69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:09.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:09.836061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:09.836810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:09.838135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:09.841158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:09.841445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:09.841721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:09.864031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:09.865491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:09.951097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:09.952475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:09.956315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 17/31] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:09.962849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:09.975764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518acea2-df7d-4995-914e-0f1f00767ac9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:10.041517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:10.042755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.043041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.043312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.043975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:10.044281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:10.045693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:10.072306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 15/32] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:10.072986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:10.161558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a1cf2-6413-4e60-8cc7-b9d4e81cea2b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:10.239443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:10.240081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.240364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.240639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.241317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:10.242736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:10.254393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afdaf-920d-4d38-aa27-6ff3f109e1f6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:10.291079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:10.292493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.293083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.293423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.294035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:10.294334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:10.295774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:10.310261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:10.311167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:10.339962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:10.428225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1193-0b36-49a0-9261-574aaf74df66 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:10.468170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:10.468801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.469080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.469367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.469560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 18/34] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 05:18:09 2022] POST /identity/v3/roles => generated 219 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:10.470254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:10.471857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:10.475724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:10.558395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:10.625287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4624-2de3-4263-86d2-4dbeb4f38119 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:10.666123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff7e7-1b7e-43c9-bb6e-f1542edfe2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:10.666874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff7e7-1b7e-43c9-bb6e-f1542edfe2ec None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.667171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff7e7-1b7e-43c9-bb6e-f1542edfe2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.667425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff7e7-1b7e-43c9-bb6e-f1542edfe2ec None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.668107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff7e7-1b7e-43c9-bb6e-f1542edfe2ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:10.669699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff7e7-1b7e-43c9-bb6e-f1542edfe2ec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:10.704067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 17/35] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:18:10 2022] POST /identity/v3/projects => generated 301 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:10.705113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 05:18:10 2022] POST /identity/v3/roles => generated 225 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f0d3e-3df9-4aa5-a4d6-af5258087520 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f0d3e-3df9-4aa5-a4d6-af5258087520 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f0d3e-3df9-4aa5-a4d6-af5258087520 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce22cb-b0a6-4901-9e7c-f0bd7c467495 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.756021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce22cb-b0a6-4901-9e7c-f0bd7c467495 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.756710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce22cb-b0a6-4901-9e7c-f0bd7c467495 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.756710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 21/38] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:10.762063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9d5e4-0f8e-4f7c-9248-cb6c995d36e6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.762620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9d5e4-0f8e-4f7c-9248-cb6c995d36e6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.762925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9d5e4-0f8e-4f7c-9248-cb6c995d36e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.789282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-47c9d5e4-0f8e-4f7c-9248-cb6c995d36e6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:10.791483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-47c9d5e4-0f8e-4f7c-9248-cb6c995d36e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:10.817374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:10.857175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11fb61-3663-400c-826f-e36ff87284ba None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:10.899964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 22/39] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:10.901382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.901678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.901963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.902482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:10.903198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:10.903482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:10.903771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:10.905358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:10.907244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:10.908971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 18/40] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:10 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:10.916457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:10.929984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:10.931660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:10.982864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:11.024503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 23/41] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:11.061648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fcf24-a071-45cb-86f1-00f813757b94 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:11.097779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:11.098342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:11.098625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:11.098934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:11.100258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:11.101708 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:11.103503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 19/42] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:11.109728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:11.199772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:11.212880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:11.216148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f22d5-33e8-47a9-bde3-d5df664cbf35 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:11.253311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:11.254267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:11.254267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:11.254535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] PATH_INFO: `/v3/domains/default/users/e8573ad460824b098e5067d101527da0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:11.256555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e8573ad460824b098e5067d101527da0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:11.258137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:11.312360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c23d-f5c9-49fb-9865-b8c11e987a3a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:11.334602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 24/43] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Aug 24 05:18:11 2022] PUT /identity/v3/domains/default/users/e8573ad460824b098e5067d101527da0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:11.335750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:11.351876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:11.352412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:11.353383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:11.353673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:11.354649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:11.356762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:11.382732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:11.440188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 20/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 05:18:11 2022] POST /identity/v3/roles => generated 223 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:18:11.467583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8d485-ce36-4df1-87aa-9188b89c751f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:11.640401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926d4f7-c562-431a-afaa-5ab8d06a2ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:11.641380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926d4f7-c562-431a-afaa-5ab8d06a2ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:11.641917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926d4f7-c562-431a-afaa-5ab8d06a2ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:11.642515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926d4f7-c562-431a-afaa-5ab8d06a2ce7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:11.643925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926d4f7-c562-431a-afaa-5ab8d06a2ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:11.645663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926d4f7-c562-431a-afaa-5ab8d06a2ce7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:11.647883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 25/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:11.653823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:11.724832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:11.758245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965a7db-d3c6-4242-810a-c87799944cc4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:11.794092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fce2f3-1308-4f2c-a02f-0633bbb459b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:11.794737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fce2f3-1308-4f2c-a02f-0633bbb459b4 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:11.795026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fce2f3-1308-4f2c-a02f-0633bbb459b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:11.795305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fce2f3-1308-4f2c-a02f-0633bbb459b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:11.795958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fce2f3-1308-4f2c-a02f-0633bbb459b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:11.797406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fce2f3-1308-4f2c-a02f-0633bbb459b4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:11.908078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 21/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:18:11 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:18:13.316068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4fbb3-d4ab-4782-905a-39234f4b5147 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:13.316628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4fbb3-d4ab-4782-905a-39234f4b5147 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:13.316715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4fbb3-d4ab-4782-905a-39234f4b5147 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:13.318063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 26/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:13.324184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:13.324608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:13.324716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:13.343482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:13.345039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:13.413184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 22/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:13.684017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4fbb3-d4ab-4782-905a-39234f4b5147 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:13.785898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4fbb3-d4ab-4782-905a-39234f4b5147 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:13.787486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:13.821026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e72a9-3562-4463-b757-c3d34f4a8394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:13.821659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e72a9-3562-4463-b757-c3d34f4a8394 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:13.821949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e72a9-3562-4463-b757-c3d34f4a8394 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:13.822229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e72a9-3562-4463-b757-c3d34f4a8394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:13.833026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e72a9-3562-4463-b757-c3d34f4a8394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-292e72a9-3562-4463-b757-c3d34f4a8394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:13.837783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:13.838765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:13.839631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 27/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:13.844799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:13.895028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:13.901464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f4c65-c905-48d2-9c52-ca8f49bec97e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:13.902360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f4c65-c905-48d2-9c52-ca8f49bec97e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:13.902649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f4c65-c905-48d2-9c52-ca8f49bec97e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:13.904056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 28/50] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:13.909219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:13.909505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:13.909784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:13.928199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:13.930426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:13.948743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055af71-cada-4dc7-a2f5-f7ba5e2df8f3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:13.983199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:13.983820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:13.984104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:13.984385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:13.985054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:13.985367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:13.986780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:13.995542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 23/51] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:13.998248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 29/52] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:14.001304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:14.101216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb1d3-a537-42e8-8c28-afb6807e31f1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:14.115048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:14.136988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:14.137882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:14.138167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:14.138445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:14.139673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:14.141522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:14.146309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 24/53] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:14 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:14.148705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:14.240417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:14.250073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d2a8a-2e63-4930-9905-e3a7ce6afe00 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:14.266815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:14.285729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:14.286369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:14.286648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:14.286968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:14.288062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:14.289529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:14.291131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 30/54] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:14.297426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:14.368939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c7a2-849e-459d-a736-2df10caed4af None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:14.395862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec947b-02da-45ff-a03f-f27129c0ad3a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:14.403334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:14.403908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:14.404191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:14.404466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:14.405575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:14.407030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:14.408590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 25/55] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:14.414081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:14.431546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:14.432835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:14.433158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:14.433445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:14.434222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.domain.id=default, user.id=e8573ad460824b098e5067d101527da0) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:14.434542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:14.436132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f93a-08b2-4dcc-9a9a-cac48a59e525 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:14.444245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 31/56] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Aug 24 05:18:14 2022] GET /identity/v3/role_assignments?user.id=e8573ad460824b098e5067d101527da0&scope.domain.id=default&role.id=afa0ce309d704597adab4050e9d32d4d => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:14.578988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:14.634681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9edb47-b24e-4651-a90b-e893fe499fd4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:14.670064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edcc95-1df3-4c6a-9d3d-9ad9d1c7b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:14.670606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edcc95-1df3-4c6a-9d3d-9ad9d1c7b4ce None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:14.670913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edcc95-1df3-4c6a-9d3d-9ad9d1c7b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:14.671198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edcc95-1df3-4c6a-9d3d-9ad9d1c7b4ce None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:14.671843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edcc95-1df3-4c6a-9d3d-9ad9d1c7b4ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:14.673286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edcc95-1df3-4c6a-9d3d-9ad9d1c7b4ce None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:14.741053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 26/57] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Aug 24 05:18:14 2022] POST /identity/v3/projects => generated 298 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:18:16.685593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66e71-e85a-4124-8694-be8ba3cab320 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:16.686140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66e71-e85a-4124-8694-be8ba3cab320 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:16.686140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66e71-e85a-4124-8694-be8ba3cab320 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:16.687530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 32/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:16.692824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:16.693233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:16.693474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:16.711745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:16.712928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:16.778424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 27/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:17.045677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de66e71-e85a-4124-8694-be8ba3cab320 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:17.074720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:17.155828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de66e71-e85a-4124-8694-be8ba3cab320 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:17.191057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e987c5d-f967-4e8f-83a7-c7056e953c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:17.191685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e987c5d-f967-4e8f-83a7-c7056e953c7a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:17.191972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e987c5d-f967-4e8f-83a7-c7056e953c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:17.192252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e987c5d-f967-4e8f-83a7-c7056e953c7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:17.193365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e987c5d-f967-4e8f-83a7-c7056e953c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:17.194866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e987c5d-f967-4e8f-83a7-c7056e953c7a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:17.196452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 33/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:17.202018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:17.232368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:17.301771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68360d8-9064-447f-bbb9-e52219976de2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:17.335191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec4ce-b7a0-46e4-84fd-107629c159f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:17.335825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec4ce-b7a0-46e4-84fd-107629c159f8 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:17.336111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec4ce-b7a0-46e4-84fd-107629c159f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:17.336388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec4ce-b7a0-46e4-84fd-107629c159f8 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:17.337096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ec4ce-b7a0-46e4-84fd-107629c159f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:17.339504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ec4ce-b7a0-46e4-84fd-107629c159f8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:17.450078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 28/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:17 2022] POST /identity/v3/users => generated 275 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:20.443334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819092-d617-49ce-b952-7257bf1e27cb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:20.444481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819092-d617-49ce-b952-7257bf1e27cb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:20.444977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819092-d617-49ce-b952-7257bf1e27cb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:20.446540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 34/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:20.452298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1fc7-bfd5-4802-b88b-6b42fed3976e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:20.452754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1fc7-bfd5-4802-b88b-6b42fed3976e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:20.452935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1fc7-bfd5-4802-b88b-6b42fed3976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:20.477718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c92e1fc7-bfd5-4802-b88b-6b42fed3976e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:20.479090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c92e1fc7-bfd5-4802-b88b-6b42fed3976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:20.569093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 29/63] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:20.625854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3548-fcf8-4f51-88e0-b27732f45d7a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:20.626503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3548-fcf8-4f51-88e0-b27732f45d7a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:20.627027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3548-fcf8-4f51-88e0-b27732f45d7a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:20.628894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 35/64] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:20.634643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b2bb-6170-41a7-8654-c0dd0730222c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:20.635505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b2bb-6170-41a7-8654-c0dd0730222c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:20.635875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b2bb-6170-41a7-8654-c0dd0730222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:20.662440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-14f6b2bb-6170-41a7-8654-c0dd0730222c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:20.663698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-14f6b2bb-6170-41a7-8654-c0dd0730222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:20.678210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:20.763905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 30/65] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:20.925755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813524a-e21a-4bb9-a260-333ae793c78d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:20.926451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813524a-e21a-4bb9-a260-333ae793c78d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:20.926987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813524a-e21a-4bb9-a260-333ae793c78d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:20.928581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 36/66] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:20.935072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b911-6735-4567-a640-0965b3fc6fa3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:20.935361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b911-6735-4567-a640-0965b3fc6fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:20.935639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b911-6735-4567-a640-0965b3fc6fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:20.959662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a6a4b911-6735-4567-a640-0965b3fc6fa3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:20.960968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a6a4b911-6735-4567-a640-0965b3fc6fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:20.965121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813524a-e21a-4bb9-a260-333ae793c78d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.042623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 31/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:21.134509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.147169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813524a-e21a-4bb9-a260-333ae793c78d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.175278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5cfb8-7df7-4679-85e1-bd6dc00f6480 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.175906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5cfb8-7df7-4679-85e1-bd6dc00f6480 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.176410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5cfb8-7df7-4679-85e1-bd6dc00f6480 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.178143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 32/68] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:21.184696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.185361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.185751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.203592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.204245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.204529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.204802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.214040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:21.215641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:21.216356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:21.221209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:21.222125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:21.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 37/69] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:21.223633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.298104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 33/70] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:21.299321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.313057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.334517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d65d-9f4f-43e9-a1e2-f7c779aab114 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.370842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b8dae-5d9b-45a5-bc34-90dbea84de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.371488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8dae-5d9b-45a5-bc34-90dbea84de7b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.371772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8dae-5d9b-45a5-bc34-90dbea84de7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.372056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8dae-5d9b-45a5-bc34-90dbea84de7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.383375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b8dae-5d9b-45a5-bc34-90dbea84de7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a19b8dae-5d9b-45a5-bc34-90dbea84de7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:21.389496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:21.390343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:21.391138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 38/71] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:21.392132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d9e0-8474-47bb-8c09-7f7b1dff6876 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.392132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d9e0-8474-47bb-8c09-7f7b1dff6876 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.397307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d9e0-8474-47bb-8c09-7f7b1dff6876 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.398844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 39/72] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:21.399680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d9e0-8474-47bb-8c09-7f7b1dff6876 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.416728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.420331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaafefc-f667-4051-ba87-c0994235407a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.461286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.461969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.462348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.462631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.464069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:21.464652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:21.466529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152e8f3-4f79-4df9-882b-d0e745f670c7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:21.476531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 34/73] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:21.477814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.478183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.479184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.499237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:21.500631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:21.521204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d9e0-8474-47bb-8c09-7f7b1dff6876 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.556486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.557346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.557633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.557905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.558582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:21.558912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:21.560743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:21.568655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.569639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 40/74] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:21.570603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.586848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 35/75] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:21.586848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.664415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.691656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676fd5-81f0-4d0e-a8cb-dbbd1408496d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.697825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3049f3-7485-4fd3-9e96-83fa47244523 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.727531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.728176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.728607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.729007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.737253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.738074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.738504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.738804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.739518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:21.745299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:21.746165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 41/76] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:21.751914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.759461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:21.761428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:21.763598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 36/77] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:21.764374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.826534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.857207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7f502-cd57-495c-a3d1-bac09f0fb74c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.872950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c979-83ac-4012-883f-fe7dc138f2ac None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:21.891712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.892340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.892619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.892891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.894026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:21.895528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:21.897095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 42/78] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:21.897852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:21.904626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:21.909353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:21.911854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:21.911854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:21.911854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:21.922248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:21.928637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:21.929513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 37/79] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:21.931377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.004694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7b38-01b5-4b12-8e1e-bc25831a5fe2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.033109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784b1b-d699-4f32-9e92-6612979a2b94 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.038443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.039092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.039372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.039644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.040314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:22.040613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.042862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.049900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.050898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 43/80] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.051697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.069149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.069772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.070053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.070337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.116994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.138715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.140255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.157707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c1cb2-05f6-4046-b683-593cbd93a915 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.190410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.191075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.191357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.191634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.192771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.194226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.198881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 44/81] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.198881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.242143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 38/82] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:22.243038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.260797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.304169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff38c85-fbd5-42bf-bb1b-325318a20629 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.333998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.339675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.340291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.340578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.340859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.342854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc37ba-afb0-42b3-87d8-eb827e3be80d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.376689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.377221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.377502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.377776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.378436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:22.378762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.380137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.389131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 39/83] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.389861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.414902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.416509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.469025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.489429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c567689-7e0b-40e2-aea3-4cac2ed5efbb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.518864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 45/84] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:22.519708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.533665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.534304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.534587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.534889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.536015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.537454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.539071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 40/85] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.539838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.553519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.627554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbe28-a171-4036-8032-ca9df5e1af93 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.640788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f89de-032b-4632-981c-bbd70d92fca9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.662516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.663162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.663446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.663725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.664405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.665906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.673799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.674433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.674740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.675023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.676150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.677575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.679245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 41/86] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.680007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.695557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.751934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 46/87] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:22 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:22.752832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.792560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c490203-f5b4-405c-9f69-70d334600f44 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.852849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.854761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.855300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.855782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.858594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.861528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.864796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 42/88] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.866185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.871734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.885847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa35c-8f2f-4a5c-9f93-2eb7efe7813f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:22.929799 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:22.930579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:22.930898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:22.931183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:22.933639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:22.935226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:22.937403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 47/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:22.938311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:22.972383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:22.998430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f6e4-cab5-41c3-9761-e20a95deedb2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.044491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.045125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.046004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.046245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.081192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0e7f0-9334-4dbc-9267-1be91af7c1bf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.128478 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.129108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.129393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.129697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.136521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.137240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=b28d99a293fb4273b56795832ee5d05f) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:23.137823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.139095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.139358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.146601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 48/90] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/role_assignments?user.id=b28d99a293fb4273b56795832ee5d05f&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=704ea304308b4c07a422828221278e65 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:23.147574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:23.175530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:23.247240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:23.265825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 43/91] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:23.271282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:23.364718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812c101-7c6a-45c8-b8e4-69facc431435 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.399027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5493e-92b5-49f0-9e4a-4f9cf906b669 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.435086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.435711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.435994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.436271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.467733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760232-08bb-48bc-830c-91918259431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.468357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760232-08bb-48bc-830c-91918259431c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.468645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760232-08bb-48bc-830c-91918259431c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.468924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760232-08bb-48bc-830c-91918259431c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.469675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86760232-08bb-48bc-830c-91918259431c None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=e8573ad460824b098e5067d101527da0) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:23.470301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86760232-08bb-48bc-830c-91918259431c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.471480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86760232-08bb-48bc-830c-91918259431c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.486631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 44/92] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:23 2022] GET /identity/v3/role_assignments?user.id=e8573ad460824b098e5067d101527da0&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:23.487515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760232-08bb-48bc-830c-91918259431c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:23.585954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.588387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:23.591085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.630263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:23.701272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760232-08bb-48bc-830c-91918259431c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.721720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 49/93] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:23.727435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:23.743107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.743755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.744143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.744428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.745597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.747086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.748909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 45/94] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:23 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:23.754465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:23.862464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddceef-af90-4970-b7c3-4dfcdd25c692 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.876952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2497-9e01-4b12-8289-3653acce2552 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:23.889070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:23.899905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.900611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.901351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.901642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.902391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] RBAC: Adding query filter params (role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=b28d99a293fb4273b56795832ee5d05f) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:23.902715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.904193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.910028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 46/95] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:23 2022] GET /identity/v3/role_assignments?user.id=b28d99a293fb4273b56795832ee5d05f&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:23.926124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:23.959027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5b42-cd83-45c1-8c33-a254a8a20677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:23.959608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5b42-cd83-45c1-8c33-a254a8a20677 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:23.959898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5b42-cd83-45c1-8c33-a254a8a20677 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:23.960183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5b42-cd83-45c1-8c33-a254a8a20677 None admin] PATH_INFO: `/v3/projects/e0c23b0671c0434982fbfbda14ff53b2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:23.961454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5b42-cd83-45c1-8c33-a254a8a20677 None admin] RBAC: Authorizing `identity:get_project(project_id=e0c23b0671c0434982fbfbda14ff53b2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:23.963788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5b42-cd83-45c1-8c33-a254a8a20677 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:23.970818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 50/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:23 2022] GET /identity/v3/projects/e0c23b0671c0434982fbfbda14ff53b2 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:23.972111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:24.117110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dcb1b-13d8-47e2-a949-8bb1157d7b7e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:24.166993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:24.167675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:24.167968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:24.168252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:24.169007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, scope.project.id=e0c23b0671c0434982fbfbda14ff53b2, user.id=b28d99a293fb4273b56795832ee5d05f) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:24.169321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:24.170832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030e1cd-f473-4984-b8ce-89778b173346 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:24.179618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 47/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:23 2022] GET /identity/v3/role_assignments?user.id=b28d99a293fb4273b56795832ee5d05f&scope.project.id=e0c23b0671c0434982fbfbda14ff53b2&role.id=704ea304308b4c07a422828221278e65 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:25.462261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24145903-3807-4eb7-ae03-eaeab666c12a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:25.463876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24145903-3807-4eb7-ae03-eaeab666c12a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:25.464382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24145903-3807-4eb7-ae03-eaeab666c12a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:25.465927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 51/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:25.471589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94477-9f8d-4dbb-bf47-8294fadcf103 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:25.472446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94477-9f8d-4dbb-bf47-8294fadcf103 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:25.472916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94477-9f8d-4dbb-bf47-8294fadcf103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:25.492730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f3d94477-9f8d-4dbb-bf47-8294fadcf103 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:25.494364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f3d94477-9f8d-4dbb-bf47-8294fadcf103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:25.533123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:25.565979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:25.744983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937428a-31e8-4cbe-ad0c-9abadea1f205 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:25.745645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937428a-31e8-4cbe-ad0c-9abadea1f205 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:25.746115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937428a-31e8-4cbe-ad0c-9abadea1f205 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:25.747712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 52/100] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:25.764523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4a4f-4def-4b4f-8be9-d3f78cb952ad None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:25.765149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4a4f-4def-4b4f-8be9-d3f78cb952ad None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:25.765653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4a4f-4def-4b4f-8be9-d3f78cb952ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:25.788778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-071f4a4f-4def-4b4f-8be9-d3f78cb952ad None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:25.790267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-071f4a4f-4def-4b4f-8be9-d3f78cb952ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:25.868680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 49/101] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:26.121191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7210cd-5466-40fa-8513-1d770cf58a2d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:26.121853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7210cd-5466-40fa-8513-1d770cf58a2d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:26.122375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7210cd-5466-40fa-8513-1d770cf58a2d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:26.123978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 53/102] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:26.129422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:26.129716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:26.129998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:26.158842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:26.160045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:26.225314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7210cd-5466-40fa-8513-1d770cf58a2d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:26.280365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 50/103] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:26.422979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7210cd-5466-40fa-8513-1d770cf58a2d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:26.461014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:26.461937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:26.462387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:26.463865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:26.465217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:26.466902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:26.468645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:26.477721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:26.510761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:26.534513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:26.611378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:26.660619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae666-7446-4d89-80e8-c2dca22e91fc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:26.700593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:26.701542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:26.701825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:26.702102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:26.713615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:26.718859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:26.719701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:26.720463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 55/105] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:26.721084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:26.793211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8479c01-3f5d-4f53-b969-78e920911fac None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:26.842517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aba97-e2a5-413d-86e4-f1b9378a644e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:26.876776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:26.882771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:26.883523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:26.884037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:26.884914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:26.897088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:26.904382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:26.906383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 56/106] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:26.908223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:26.914488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75463be-fa75-4124-9a86-d791c0dd2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:26.914488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75463be-fa75-4124-9a86-d791c0dd2927 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:26.914488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75463be-fa75-4124-9a86-d791c0dd2927 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:26.914488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75463be-fa75-4124-9a86-d791c0dd2927 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:26.915116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75463be-fa75-4124-9a86-d791c0dd2927 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:26.916947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75463be-fa75-4124-9a86-d791c0dd2927 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.001879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 51/107] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:18:26 2022] POST /identity/v3/projects => generated 302 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:27.004472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27f66-620a-4691-8629-21c64c4e558a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.005007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27f66-620a-4691-8629-21c64c4e558a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.005774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27f66-620a-4691-8629-21c64c4e558a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.008210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 52/108] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:27.009060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27f66-620a-4691-8629-21c64c4e558a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.035566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8877d77-c835-446e-abcf-039e1e9edc18 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.079484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.080595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.081094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.081639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.082527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:27.083059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:27.084836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ed22-8699-471c-816b-2ad94120e4e9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.095084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 57/109] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:27.096778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792bfb-2ddf-4d0a-b78b-92bb502d7875 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.097127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792bfb-2ddf-4d0a-b78b-92bb502d7875 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.097468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792bfb-2ddf-4d0a-b78b-92bb502d7875 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.099007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 58/110] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:27.100005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf76c1-6050-469a-95b4-89cb41be4d6b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.100293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf76c1-6050-469a-95b4-89cb41be4d6b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.100565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf76c1-6050-469a-95b4-89cb41be4d6b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.101958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 59/111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:27.107706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41523-3529-46ba-84fb-fda5d905b88f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.108522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41523-3529-46ba-84fb-fda5d905b88f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.108954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41523-3529-46ba-84fb-fda5d905b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.127690 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:27.135609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1ce41523-3529-46ba-84fb-fda5d905b88f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:27.136817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ce41523-3529-46ba-84fb-fda5d905b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:27.152867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27f66-620a-4691-8629-21c64c4e558a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.180938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:27.195831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.196458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.196741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.197870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.199080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:27.199403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:27.200835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.210465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 53/112] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:27.211352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.234454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 60/113] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:27.234454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900ac65-9a30-4cda-9ebb-0dc145595472 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.234454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900ac65-9a30-4cda-9ebb-0dc145595472 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.234454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900ac65-9a30-4cda-9ebb-0dc145595472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.255939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c900ac65-9a30-4cda-9ebb-0dc145595472 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:27.257071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c900ac65-9a30-4cda-9ebb-0dc145595472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:27.330461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adfe25-2fa9-4032-979a-9a8c36aacb52 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.350749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 61/114] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:27.352841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.353895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.354422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.375379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:27.377260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:27.391000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.391743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.391991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.392289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.397223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:27.399195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.401818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 54/115] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:27 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:27.402454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.436401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:27.460664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 62/116] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:27.462461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.497623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:27.607546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757b371-af7a-4702-bd59-db1fb56518bb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.635204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa810291-bf1b-498d-91ab-4f394ad3815d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.675789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.676426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.676703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.676972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.678217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:27.680888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.683546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 63/117] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:27 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:27.684104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.731460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.732124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.732482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.732766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] PATH_INFO: `/v3/users/d0d89631b71540e1a52fb5a0e2838ac1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.756322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] RBAC: Authorizing `identity:get_user(user_id=d0d89631b71540e1a52fb5a0e2838ac1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:27.757834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.760700 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 55/118] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:27 2022] GET /identity/v3/users/d0d89631b71540e1a52fb5a0e2838ac1 => generated 289 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:27.761331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.797227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:27.803250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748f591-80c9-45e8-b0d6-e91cc0fbb6e0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.839789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.840614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.840993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.841369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.854164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:27.857853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:27.858949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:27.859816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 64/119] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:27.870149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:27.893153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4517c-78b5-49d1-9fe6-a0fcda54c925 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:27.932200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:27.932976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:27.933263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:27.933549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/b28d99a293fb4273b56795832ee5d05f/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:27.935611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] RBAC: Authorizing `identity:create_grant(project_id=67330f8be90f496e8bd37bc02087f8ae, user_id=b28d99a293fb4273b56795832ee5d05f, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:27.937246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:27.972546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fd7c5-d008-4067-90d3-e92363fa2a80 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.002923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 56/120] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:27 2022] PUT /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/b28d99a293fb4273b56795832ee5d05f/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:28.010928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.010928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.010928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.010928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.012584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.023356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:28.029205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:28.030177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:28.031056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 65/121] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:28.035674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.061185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.184719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bb13b-ec57-42f5-bc42-ac73b5782202 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.194149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faa945-5bb8-4103-bba3-2236505c5e51 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.231220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.231870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.232152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.232428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.237877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.244420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.245548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.245920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.246275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.248723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:28.255386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:28.256922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:28.257766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 66/122] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:28.262716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.351117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.354393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:28.356507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:28.377615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265ceb-73c3-432c-bb54-eea2833dc400 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.418483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.419186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.419469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.419746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.420474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:28.420856 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:28.422275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:28.431407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 67/123] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:28.432344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.505636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 57/124] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:28.506366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.547793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.553805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f02873-8028-44f9-a8eb-609e548d35c5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.611801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.612454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.612747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.613022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.613793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:28.614097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:28.615525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:28.622488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.630575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 68/125] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:28.631461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.647247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869b1b-91f5-4d24-9682-e677322e6d53 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.699302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.701626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.702327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.703018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.704245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:28.705382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:28.707599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:28.724526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 58/126] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:28.724526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.752938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b96a-bfd3-4de5-9f61-20fcc574e60f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.802890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.803876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.804358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.804836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.806370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:28.808818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:28.811232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 69/127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:28.812753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.833599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.843422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31246a-aa84-4f7a-87f1-37772ef6c8e4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:28.881768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:28.882421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:28.882714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:28.883019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:28.884167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:28.886499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:28.888861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 59/128] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:28.890187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:28.908475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:28.956538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c609d-5621-4efb-9e58-bb4a2ecb16fb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.005203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.005520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe346-7753-4cd5-8798-5a8119540e49 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.006275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.006719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.007388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.010172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.011864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.013888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 70/129] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:29.014828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.046723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.047610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.048039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.048398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.049698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.051506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.053587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 60/130] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:28 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:29.058443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.105513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:29.162112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26e467-ca0d-44ba-bd19-f3f98dad4510 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.189672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60de2-d55f-4030-9c25-8de01a9b3602 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.210992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.211983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.212498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.213601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] PATH_INFO: `/v3/projects/e0c23b0671c0434982fbfbda14ff53b2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.215063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] RBAC: Authorizing `identity:get_project(project_id=e0c23b0671c0434982fbfbda14ff53b2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.216744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.218606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 71/131] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:29 2022] GET /identity/v3/projects/e0c23b0671c0434982fbfbda14ff53b2 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:29.219616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.225438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:29.234100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.234880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.235170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.235447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.236306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] RBAC: Adding query filter params (role.id=3232e1e490914d778785be7b1c3c0090, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=d0d89631b71540e1a52fb5a0e2838ac1) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:29.236625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.238197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.246803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 61/132] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:29 2022] GET /identity/v3/role_assignments?user.id=d0d89631b71540e1a52fb5a0e2838ac1&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=3232e1e490914d778785be7b1c3c0090 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:29.247641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.385784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:29.396335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad57a7-8632-4ed7-aab7-0be477203f9b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.396623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e45a0-8f4b-4579-8f15-be8faa7898ef None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.452581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6d1ad-e5d6-4030-a946-1df9120cf442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.453688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d1ad-e5d6-4030-a946-1df9120cf442 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.454122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d1ad-e5d6-4030-a946-1df9120cf442 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.454617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d1ad-e5d6-4030-a946-1df9120cf442 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.456131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6d1ad-e5d6-4030-a946-1df9120cf442 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.457091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.457953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6d1ad-e5d6-4030-a946-1df9120cf442 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.458074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.458422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.458898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.460635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 62/133] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:29 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:29.460965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.463014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62bfc-60ee-44b6-8563-e4d110157165 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.463465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62bfc-60ee-44b6-8563-e4d110157165 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.463993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62bfc-60ee-44b6-8563-e4d110157165 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.464338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.465671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 63/134] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:29.466667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d62bfc-60ee-44b6-8563-e4d110157165 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.473134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 72/135] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:29 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:29.474023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.589413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:29.644273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d62bfc-60ee-44b6-8563-e4d110157165 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.645891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155978-55a2-4c25-a0c6-30d93928784f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:29.694326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.695646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.696137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.696265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8310f6-3822-45a1-9a8d-0a1732b53430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:29.697523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8310f6-3822-45a1-9a8d-0a1732b53430 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.697886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/b28d99a293fb4273b56795832ee5d05f/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.698461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8310f6-3822-45a1-9a8d-0a1732b53430 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.698808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8310f6-3822-45a1-9a8d-0a1732b53430 None admin] PATH_INFO: `/v3/projects/e0c23b0671c0434982fbfbda14ff53b2/users/b28d99a293fb4273b56795832ee5d05f/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.700846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8310f6-3822-45a1-9a8d-0a1732b53430 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0c23b0671c0434982fbfbda14ff53b2, user_id=b28d99a293fb4273b56795832ee5d05f, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.701592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=67330f8be90f496e8bd37bc02087f8ae, user_id=b28d99a293fb4273b56795832ee5d05f, role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:29.702309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8310f6-3822-45a1-9a8d-0a1732b53430 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.703526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:29.802736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 64/136] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:29 2022] PUT /identity/v3/projects/e0c23b0671c0434982fbfbda14ff53b2/users/b28d99a293fb4273b56795832ee5d05f/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:29.802736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e433-e119-4e99-b490-cf32cb38a834 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:29.802736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e433-e119-4e99-b490-cf32cb38a834 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:29.802736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e433-e119-4e99-b490-cf32cb38a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:29.817518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 73/137] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:29 2022] PUT /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/b28d99a293fb4273b56795832ee5d05f/roles/17bb4391783f400d995fb75b6e3f4684 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:29.827536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:29.831532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1859e433-e119-4e99-b490-cf32cb38a834 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:29.833128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1859e433-e119-4e99-b490-cf32cb38a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:29.882904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:30.017818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c39e-0430-448d-bcc6-9257e2ab9d25 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:30.061233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 65/138] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:30.067107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:30.073400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c0d35-a570-4d07-bc5b-809b24c7344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:30.074973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0d35-a570-4d07-bc5b-809b24c7344c None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:30.075654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0d35-a570-4d07-bc5b-809b24c7344c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:30.076275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0d35-a570-4d07-bc5b-809b24c7344c None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/e8573ad460824b098e5067d101527da0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:30.080055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c0d35-a570-4d07-bc5b-809b24c7344c None admin] RBAC: Authorizing `identity:create_grant(project_id=67330f8be90f496e8bd37bc02087f8ae, user_id=e8573ad460824b098e5067d101527da0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:30.080969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c0d35-a570-4d07-bc5b-809b24c7344c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:30.136483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 74/139] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:29 2022] PUT /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/e8573ad460824b098e5067d101527da0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:30.261883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ed60-8f42-4f8e-8269-54fcee5f53c5 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:30.262511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ed60-8f42-4f8e-8269-54fcee5f53c5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:30.262825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ed60-8f42-4f8e-8269-54fcee5f53c5 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:30.264392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 66/140] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:30.272109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:30.272727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:30.273265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:30.302158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:30.303808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:30.395972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 75/141] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:30.568841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0ed60-8f42-4f8e-8269-54fcee5f53c5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:30.720068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0ed60-8f42-4f8e-8269-54fcee5f53c5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:30.769620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:30.770270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:30.770554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:30.770861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:30.771998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:30.773464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:30.775642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 67/142] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:30.781482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:30.819611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:30.878617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:30.957290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875231a-0a08-4a30-ae1c-b5774ec95c80 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:31.008420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:31.045605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:31.046582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.047080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.047684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.048544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:31.051921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:31.064926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44857-1658-4457-87bb-b531c1374bdd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:31.123261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:31.124406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.124905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.125371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.142062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:31.147614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:31.155397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:31.156209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 68/143] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:31.157853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:31.198724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 76/144] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:30 2022] POST /identity/v3/users => generated 283 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:31.290932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:31.309548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57f5a8-5dd4-4066-96c3-719e7a9d235f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:31.362718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:31.363341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.363623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.363899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.364589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:31.364896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:31.366329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:31.376498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 69/145] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:31.382049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:31.538245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d67a-bf2c-424c-a95b-89021fc5fb72 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:31.589879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194720-171f-4719-8f03-2ed0728c0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:31.590538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194720-171f-4719-8f03-2ed0728c0cca None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.590856 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194720-171f-4719-8f03-2ed0728c0cca None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.591138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194720-171f-4719-8f03-2ed0728c0cca None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.592724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194720-171f-4719-8f03-2ed0728c0cca None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:31.595235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194720-171f-4719-8f03-2ed0728c0cca None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:31.598041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 77/146] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:31 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:31.605118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:31.749367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8c1c-8110-4cdc-abf5-c17ff650e259 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:31.795783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:31.796809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.797337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.797802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.815831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:31.877495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018cb9-bf75-4650-8505-d06304d5e679 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.878019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018cb9-bf75-4650-8505-d06304d5e679 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.878019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018cb9-bf75-4650-8505-d06304d5e679 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.880819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 78/147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:31.888402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:31.888689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:31.888972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:31.891311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:31.892893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:31.913423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:31.914630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:31.983244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:32.023035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 79/148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:32.068098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 70/149] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:32.074601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:32.193282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9ace3-00b2-4475-a41d-403d08e278ee None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:32.233853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:32.234497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:32.234805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:32.235133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:32.236273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:32.237790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:32.240793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 80/150] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:32 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:32.246649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:32.294219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:32.355859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239f3d5-ad2b-4f5b-888b-2c221fbeddde None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:32.392875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:32.393543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:32.393830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:32.394107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:32.394887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=b28d99a293fb4273b56795832ee5d05f) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:32.395203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:32.396797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:32.404210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 71/151] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:32 2022] GET /identity/v3/role_assignments?user.id=b28d99a293fb4273b56795832ee5d05f&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=704ea304308b4c07a422828221278e65 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:32.447021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:32.512998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:32.580747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c6788-96c5-411e-af76-2906a06b4fc3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:32.638872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:32.639534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:32.639814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:32.640086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:32.657562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:32.662367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:32.663251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:32.663999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 81/152] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:32.670949 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:32.813771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c36af-2f57-4bcc-af07-5e6a2fd762fe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:32.822287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:32.851120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:32.851655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:32.851939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:32.852213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:32.853536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:32.853846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:32.855282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a7d90-4fc9-427c-9720-77ea57a1fdbc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:32.867939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 72/153] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:32.873746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:32.976095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbecd6f-f655-40e0-8d48-09d08d1e357e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:32.976659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbecd6f-f655-40e0-8d48-09d08d1e357e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:32.977110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbecd6f-f655-40e0-8d48-09d08d1e357e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:32.980871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 73/154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:32.987307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d018812-8ae4-4b40-ad74-a5b62426c6b2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:32.987915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d018812-8ae4-4b40-ad74-a5b62426c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:32.988364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d018812-8ae4-4b40-ad74-a5b62426c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:33.012834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5071d9-bc2a-49ab-85c9-772117e2fa8e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:33.019832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6d018812-8ae4-4b40-ad74-a5b62426c6b2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:33.021336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6d018812-8ae4-4b40-ad74-a5b62426c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:33.030747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:33.073595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:33.074258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:33.074537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:33.075838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] PATH_INFO: `/v3/users/d0d89631b71540e1a52fb5a0e2838ac1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:33.077455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] RBAC: Authorizing `identity:get_user(user_id=d0d89631b71540e1a52fb5a0e2838ac1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:33.078961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:33.081853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 82/155] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:32 2022] GET /identity/v3/users/d0d89631b71540e1a52fb5a0e2838ac1 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:33.088986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:33.191545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 74/156] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:33.192817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7253-ce96-4134-849e-97bad49c08f1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:33.193990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7253-ce96-4134-849e-97bad49c08f1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:33.193990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7253-ce96-4134-849e-97bad49c08f1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:33.194660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 75/157] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:33.208309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:33.208592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:33.208854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:33.242745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:33.244592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:33.299679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208279c5-a47e-47f4-8c8f-292a2b9b47ce None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:33.373494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:33.374143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:33.374422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:33.374728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:33.376160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:33.377640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:33.380713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 83/158] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:33 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:33.390718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:33.398241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 76/159] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:33.496217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:33.589216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c1d44-5dca-470f-835b-69cd9b52ea64 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:33.686169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:33.686882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:33.687166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:33.687442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/d0d89631b71540e1a52fb5a0e2838ac1/roles/3232e1e490914d778785be7b1c3c0090` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:33.689397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=67330f8be90f496e8bd37bc02087f8ae, user_id=d0d89631b71540e1a52fb5a0e2838ac1, role_id=3232e1e490914d778785be7b1c3c0090)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:33.690903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:33.760728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 84/160] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:33 2022] PUT /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae/users/d0d89631b71540e1a52fb5a0e2838ac1/roles/3232e1e490914d778785be7b1c3c0090 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:33.816367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:33.855584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:33.866753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:34.046823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:34.050609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109099-2a6d-4234-a5c0-f8c32a69b0b7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.060767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3764e9-a3b2-4e3f-8647-0df868d40911 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.098110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e248ac-31ba-493a-9997-521bf50d849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.098787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e248ac-31ba-493a-9997-521bf50d849b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.099070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e248ac-31ba-493a-9997-521bf50d849b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.099340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e248ac-31ba-493a-9997-521bf50d849b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.102155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.103381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.103720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.112710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.112837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e248ac-31ba-493a-9997-521bf50d849b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-34e248ac-31ba-493a-9997-521bf50d849b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:34.116404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:34.117252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:34.118952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 77/161] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:34.120599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:34.120738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e874-6ce7-4fe7-a3ff-7fe51f0fb043 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.120738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e874-6ce7-4fe7-a3ff-7fe51f0fb043 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.120738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e874-6ce7-4fe7-a3ff-7fe51f0fb043 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.121175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 78/162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:34.123675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:34.125919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:34.127890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 85/163] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:18:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:34.129431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.129431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.129431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.134611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:34.152819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:34.154033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:34.301411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 79/164] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:34.303213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:34.328242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1248-8def-47d5-b0ed-64a14b5e539a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.340546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:34.404647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.405540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.405840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.406545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.407281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:34.407589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:34.409000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:34.424428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 86/165] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:34.430764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:34.477116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:34.513724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d3190-2b5a-4e94-8c78-b2dece5ce155 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.580536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.581554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.582033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.582554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.583477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:34.583982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:34.585584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:34.603144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 80/166] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:18:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:34.616627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:34.642809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc411d-be5c-4ce1-837f-904bce812bb9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.684083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.684739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.685021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.685294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] PATH_INFO: `/v3/users/e8573ad460824b098e5067d101527da0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.686476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] RBAC: Authorizing `identity:get_user(user_id=e8573ad460824b098e5067d101527da0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:34.688260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:34.691209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 87/167] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:34 2022] GET /identity/v3/users/e8573ad460824b098e5067d101527da0 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:34.697949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:34.833338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:34.856407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:34.874992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8692-f67b-40c5-9b44-b4f3f04a0516 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.882681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5a83-15f1-465a-a77f-aae482f63610 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:34.929905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.930573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.931127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.931545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.975575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:34.976230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:34.976508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:34.976779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:34.980016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:34.981482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:34.983160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 81/168] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:34 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:34.983935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:35.052139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:35.053894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:35.177016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:35.189761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 88/169] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:35.190938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:35.245580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9fa1d-8b87-4524-9cd4-1f02ef4e5a52 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:35.323724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:35.324877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:35.325997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:35.326611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:35.337650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd238-baf2-48eb-a45f-3d50a18ce5f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:35.350563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:35.357207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:35.358247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:35.359049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:35.361196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 82/170] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:35.362178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:35.395098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:35.448482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:35.449027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:35.449305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:35.449576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:35.479446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54b00-f8dd-4aa9-848f-0ce98de073e5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:35.517831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:35.518716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:35.519111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:35.519489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:35.520761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:35.522392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:35.524424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 83/171] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:35 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:35.530359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:35.557960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:35.585021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:35.586922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:35.677089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:35.746857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ae94-516b-4c76-84d2-ade904483d1a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:35.828851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 89/172] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:35.829887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:35.831439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:35.832073 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:35.832351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:35.832626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:35.833305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:35.833606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:35.835331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf77786-77b0-457e-8a53-88c34aef171d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:35.862055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 84/173] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:35.868034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1daac-b2eb-482a-a665-b61f879d87ce None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:35.868034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1daac-b2eb-482a-a665-b61f879d87ce None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:35.868034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1daac-b2eb-482a-a665-b61f879d87ce None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:35.868034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 85/174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:35.868034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1daac-b2eb-482a-a665-b61f879d87ce None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:36.017663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:36.028274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793905ea-7001-4d2a-8cab-7ee9487a4052 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:36.044120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1daac-b2eb-482a-a665-b61f879d87ce None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:36.067503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:36.068180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.068443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.068713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.069510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=e8573ad460824b098e5067d101527da0) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:36.069818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:36.071619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:36.078304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 90/175] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:35 2022] GET /identity/v3/role_assignments?user.id=e8573ad460824b098e5067d101527da0&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:36.082745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:36.104037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028d773-dbb5-4e20-870c-96faba7e4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:36.104740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028d773-dbb5-4e20-870c-96faba7e4003 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.105026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028d773-dbb5-4e20-870c-96faba7e4003 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.105897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028d773-dbb5-4e20-870c-96faba7e4003 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.107106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028d773-dbb5-4e20-870c-96faba7e4003 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:36.109303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028d773-dbb5-4e20-870c-96faba7e4003 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:36.111280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 86/176] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:35 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:36.113104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e5d2-4710-4fca-be06-7c34c7881ef1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.113490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e5d2-4710-4fca-be06-7c34c7881ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.113764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e5d2-4710-4fca-be06-7c34c7881ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.129828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:36.138349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b1a9e5d2-4710-4fca-be06-7c34c7881ef1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:36.140598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b1a9e5d2-4710-4fca-be06-7c34c7881ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:36.273971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 87/177] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:36.276100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48ef6-fb57-4547-8911-9aee7652945f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.276774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48ef6-fb57-4547-8911-9aee7652945f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.277320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48ef6-fb57-4547-8911-9aee7652945f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.279171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 88/178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:36.280439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48ef6-fb57-4547-8911-9aee7652945f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:36.291313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c6a0-1dd7-433c-a287-09cb57be7b9b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:36.341303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b777-cc40-47c1-b436-5a0e1bbc30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:36.341855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b777-cc40-47c1-b436-5a0e1bbc30f7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.342132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b777-cc40-47c1-b436-5a0e1bbc30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.342449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b777-cc40-47c1-b436-5a0e1bbc30f7 None admin] PATH_INFO: `/v3/users/b28d99a293fb4273b56795832ee5d05f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.344351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b777-cc40-47c1-b436-5a0e1bbc30f7 None admin] RBAC: Authorizing `identity:get_user(user_id=b28d99a293fb4273b56795832ee5d05f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:36.347031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b777-cc40-47c1-b436-5a0e1bbc30f7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:36.349040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 91/179] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:36 2022] GET /identity/v3/users/b28d99a293fb4273b56795832ee5d05f => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:36.350258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ae796-054b-4524-a91e-b847e6e2ff47 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.350540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ae796-054b-4524-a91e-b847e6e2ff47 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.350838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ae796-054b-4524-a91e-b847e6e2ff47 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.352479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 92/180] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:36.358902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.359487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.359766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.381015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:36.382577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:36.405829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:36.431782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48ef6-fb57-4547-8911-9aee7652945f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:36.481378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 93/181] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:36.482219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:36.487077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:36.487705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.487978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.488252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.489003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] RBAC: Adding query filter params (role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=b28d99a293fb4273b56795832ee5d05f) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:36.489309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:36.490863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02b13-c5d9-48a6-b2dd-6b3d3b21153b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:36.494765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:36.498607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 89/182] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:36 2022] GET /identity/v3/role_assignments?user.id=b28d99a293fb4273b56795832ee5d05f&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:36.500019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda086f-2fc4-41e1-8cab-2b5e491fb0cb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.500314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda086f-2fc4-41e1-8cab-2b5e491fb0cb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.500588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda086f-2fc4-41e1-8cab-2b5e491fb0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.521654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9cda086f-2fc4-41e1-8cab-2b5e491fb0cb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:36.523307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9cda086f-2fc4-41e1-8cab-2b5e491fb0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:36.635093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071145-ca97-461f-bc47-e4987b4ce9a2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:36.645975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 90/183] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:36.647568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f271-850c-4a5e-8e69-d181433b947c None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.648005 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f271-850c-4a5e-8e69-d181433b947c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.648283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f271-850c-4a5e-8e69-d181433b947c None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.650246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 91/184] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:36.651101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f271-850c-4a5e-8e69-d181433b947c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:36.703196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:36.703836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.704113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.704382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.729756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:36.787181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:36.788997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:36.802947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f271-850c-4a5e-8e69-d181433b947c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:36.847966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:36.855394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e2084-723f-4ece-9f42-ef6e01fd056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:36.855989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e2084-723f-4ece-9f42-ef6e01fd056e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.856370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e2084-723f-4ece-9f42-ef6e01fd056e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.856699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e2084-723f-4ece-9f42-ef6e01fd056e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.874907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e2084-723f-4ece-9f42-ef6e01fd056e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9c2e2084-723f-4ece-9f42-ef6e01fd056e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:36.879931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:36.880963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:36.881825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 92/185] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:18:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:36.888361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:36.888640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:36.890097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:36.907499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:36.908699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:36.935596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 94/186] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:36.936499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.011824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 93/187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:37.012042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.012993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.068335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1808ad-a447-4754-a37c-aba46211adaa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.112721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.113301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.113583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.113858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.131352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:37.136427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:37.138126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:37.138973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:37.139617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de369-ed0e-4c0e-b4cd-1cea3ce5c170 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.139698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 95/188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:37.143548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.167156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.182198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.194845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.194845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.194845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.194845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:37.194845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.194845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.202098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 94/189] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.202098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.283646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cd61-ca40-455d-9e33-d545abf3e1b0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.315403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.322569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f9acb-9966-452f-b21c-7d523d4f4fe1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.339276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.339967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.340244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.340510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] PATH_INFO: `/v3/projects/e0c23b0671c0434982fbfbda14ff53b2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.341676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] RBAC: Authorizing `identity:get_project(project_id=e0c23b0671c0434982fbfbda14ff53b2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.343202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.344857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 96/190] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/projects/e0c23b0671c0434982fbfbda14ff53b2 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.345632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.366156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.366730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.367014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.367287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.369140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.370665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.372474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 95/191] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.373082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.432959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.461804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d97915-c088-401c-bc8c-28ae311832bf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.485379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff6c6-b4d0-4a48-bae9-7a4c8d7d817b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.498462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.499106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.499385 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.499655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.500328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:37.500630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.502054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.511489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 97/192] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.512595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.529649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.530290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.530570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.530889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] PATH_INFO: `/v3/users/95f0d18881c4494bb7487bda7c397e58` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.546869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] RBAC: Authorizing `identity:get_user(user_id=95f0d18881c4494bb7487bda7c397e58)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.548422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.550387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 96/193] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/users/95f0d18881c4494bb7487bda7c397e58 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.551188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.566866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.637822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32fce1-ec80-4117-bdf0-ddc950016a26 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.670818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2686837-be04-4223-b4dc-ddef00ff3e56 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.673524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.674161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.674435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.674722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.681215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.690038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:37.695302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:37.697872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 98/194] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:37.700156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.712760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.713488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.713808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.714094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.714872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, scope.project.id=e0c23b0671c0434982fbfbda14ff53b2, user.id=b28d99a293fb4273b56795832ee5d05f) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:37.715183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.716638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.723402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 97/195] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/role_assignments?user.id=b28d99a293fb4273b56795832ee5d05f&scope.project.id=e0c23b0671c0434982fbfbda14ff53b2&role.id=704ea304308b4c07a422828221278e65 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.724242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.837854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8af8-a0e1-45b0-b008-01fb2bdb65a8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.840052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.859505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40f06-8777-4990-a9f5-182fdae17297 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:37.880136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.880875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.881029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.881304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.881967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.883492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.901094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:37.901620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:37.901908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:37.902813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] PATH_INFO: `/v3/users/95f0d18881c4494bb7487bda7c397e58` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:37.903441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] RBAC: Authorizing `identity:get_user(user_id=95f0d18881c4494bb7487bda7c397e58)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:37.904966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:37.906570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 98/196] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/users/95f0d18881c4494bb7487bda7c397e58 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:37.907374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:37.956750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:37.985648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 99/197] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:37 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:37.986521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.034578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3bce-c22c-45eb-a0af-6928b1563b80 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.078976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.079644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.079925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.080205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.110422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355441a-93eb-403d-b10c-87245db07e09 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.156916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.158313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.158536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.159227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.159505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.159779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.160470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:38.160766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.162163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.172737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 100/198] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:38.173604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.201117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.215309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.299330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 99/199] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:38.299723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8206-6630-4872-a69a-3b32a549acb0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.300921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.356247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d2360-5efb-4934-8877-da995619b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.356885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d2360-5efb-4934-8877-da995619b931 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.357164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d2360-5efb-4934-8877-da995619b931 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.357435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d2360-5efb-4934-8877-da995619b931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.443504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d2360-5efb-4934-8877-da995619b931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.445376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d2360-5efb-4934-8877-da995619b931 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.458288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e492e-9c3a-4f45-bde1-ee1e945dba68 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.470640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.504746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.505406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.505684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.505956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] PATH_INFO: `/v3/users/d0d89631b71540e1a52fb5a0e2838ac1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.508264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] RBAC: Authorizing `identity:get_user(user_id=d0d89631b71540e1a52fb5a0e2838ac1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.510547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.513412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 100/200] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:38 2022] GET /identity/v3/users/d0d89631b71540e1a52fb5a0e2838ac1 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:38.514546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.528640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.586624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 101/201] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:38.589668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d2360-5efb-4934-8877-da995619b931 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.655056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4433ab0-0021-4d4c-9485-e365d578e975 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.695436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.697360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.697844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.698306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.700165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.702928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.704846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 101/202] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:38 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:38.705830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.734902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d2360-5efb-4934-8877-da995619b931 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.761844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.778516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.779621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.780117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.780606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.807028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.834257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248079-e929-4179-9bf0-3f4b6c0d95c5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:38.875768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.878031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.879776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:38.880550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:38.880926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:38.881297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:38.884681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:38.886301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:38.888423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 102/203] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:38 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:38.889297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:38.998426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf885b-a97e-4a57-bb70-abdfbfb82a1a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:39.009028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 102/204] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:39.009961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:39.034190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:39.035758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:39.036692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:39.037106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:39.037515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:39.038539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] RBAC: Adding query filter params (role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=95f0d18881c4494bb7487bda7c397e58) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:39.039021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:39.040681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:39.047030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 103/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:38 2022] GET /identity/v3/role_assignments?user.id=95f0d18881c4494bb7487bda7c397e58&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:39.048010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:39.062254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:39.136841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056038b5-09c8-4b59-be66-e70b5744c56f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:39.184388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:39.185473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:39.185950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:39.186414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:39.187418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=95f0d18881c4494bb7487bda7c397e58) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:39.187950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:39.189814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:39.199790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 103/206] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:39 2022] GET /identity/v3/role_assignments?user.id=95f0d18881c4494bb7487bda7c397e58&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:39.224905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbc48d-5f61-43d3-bebf-2d443b96bc0d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:39.265739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a760402-cc29-4cca-b2d5-d86597dbb9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:39.266321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760402-cc29-4cca-b2d5-d86597dbb9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:39.266600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760402-cc29-4cca-b2d5-d86597dbb9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:39.266965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760402-cc29-4cca-b2d5-d86597dbb9d4 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:39.268173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760402-cc29-4cca-b2d5-d86597dbb9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:39.269644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760402-cc29-4cca-b2d5-d86597dbb9d4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:39.271361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 104/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:39 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:39.281383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:39.388761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:39.406394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126028-e068-44db-91fc-37f6a886c0ce None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:39.450597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:39.451519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:39.451942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:39.452358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:39.453254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] RBAC: Adding query filter params (role.id=3232e1e490914d778785be7b1c3c0090, scope.project.id=67330f8be90f496e8bd37bc02087f8ae, user.id=d0d89631b71540e1a52fb5a0e2838ac1) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:39.453717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:39.455372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb57a6-e360-4869-8065-c710b252fb6c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:39.462475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 104/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:39 2022] GET /identity/v3/role_assignments?user.id=d0d89631b71540e1a52fb5a0e2838ac1&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=3232e1e490914d778785be7b1c3c0090 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:40.673651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac993-98ff-4fb0-ad5a-c803da490542 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:40.674650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac993-98ff-4fb0-ad5a-c803da490542 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:40.675154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac993-98ff-4fb0-ad5a-c803da490542 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:40.676974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 105/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:40.683487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:40.684354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:40.684836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:40.704625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:40.706151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:40.784988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 105/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:41.074351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac993-98ff-4fb0-ad5a-c803da490542 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:41.159687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:41.184960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac993-98ff-4fb0-ad5a-c803da490542 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:41.224956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4f17c-d756-498f-b977-a7c2301ae868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:41.226034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f17c-d756-498f-b977-a7c2301ae868 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.226034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f17c-d756-498f-b977-a7c2301ae868 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.226203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f17c-d756-498f-b977-a7c2301ae868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.227682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4f17c-d756-498f-b977-a7c2301ae868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:41.228806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4f17c-d756-498f-b977-a7c2301ae868 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:41.230737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 106/211] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:41.236436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:41.317482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434ea2-c8f2-45dd-88c9-1134677507e7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.317714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434ea2-c8f2-45dd-88c9-1134677507e7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.318021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434ea2-c8f2-45dd-88c9-1134677507e7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.319635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 107/212] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:41.324780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:41.325025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498016f-2847-4586-b4eb-8d8d9cd5f969 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.325288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498016f-2847-4586-b4eb-8d8d9cd5f969 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.325566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498016f-2847-4586-b4eb-8d8d9cd5f969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.345698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e498016f-2847-4586-b4eb-8d8d9cd5f969 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:41.347180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e498016f-2847-4586-b4eb-8d8d9cd5f969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:41.349848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f2231-997d-4821-a019-7b817b1883ba None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:41.387132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:41.387999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.388277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.388555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.389460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:41.390685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:41.464918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 108/213] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:41.467391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134e9cb-0cd4-497a-9e96-fe5d4e0d2579 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.467908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134e9cb-0cd4-497a-9e96-fe5d4e0d2579 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.468405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134e9cb-0cd4-497a-9e96-fe5d4e0d2579 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.477628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 109/214] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:41.479733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 106/215] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:41 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:18:41.487026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.487026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.487026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.517397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:41.519543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:41.632852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 110/216] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:41.775254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:41.895485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca7db1-c71c-4fd7-8dbe-68daf059ab5a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:41.933524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:41.934172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:41.934450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:41.934888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:41.936899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:41.947267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:41.952170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:41.959054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:41.959828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 107/217] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:18:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:41.962553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:41.967282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:42.072207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7bbb5-4a71-49fd-919f-3e29967add5b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:42.113331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:42.114332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.114905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.115392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.116281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:42.116774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:42.119043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:42.132944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 111/218] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:18:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:42.139855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.153930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.282222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:42.380250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c200f-ec98-4b26-ba1b-a6e3dae8a34f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:42.382510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186702-3b82-4f9c-817a-9222264c1821 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:42.421681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:42.422774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.423262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.423923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.436256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:42.442995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:42.444087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:42.444890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:42.453881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 112/219] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:42.455659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.484242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:42.484242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.484242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.484242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] PATH_INFO: `/v3/users/95f0d18881c4494bb7487bda7c397e58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.491606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=95f0d18881c4494bb7487bda7c397e58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:42.493252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:42.495533 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 108/220] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:42 2022] GET /identity/v3/users/95f0d18881c4494bb7487bda7c397e58 => generated 283 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:42.500934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.585061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0119-a3d2-40d9-ab43-e087a8b119fe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:42.589517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:42.623311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:42.632081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:42.632612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.632892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.633165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.634646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:42.634968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:42.636347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af352-f3a4-47fd-85c2-566c25134bf2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:42.649684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 113/221] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:42.649684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fd4d-b149-4f47-8662-189a3229091b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.649684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fd4d-b149-4f47-8662-189a3229091b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.649684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fd4d-b149-4f47-8662-189a3229091b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.649684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 114/222] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:42.654664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a5446-1640-4edf-9190-7595ea353dc8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:42.655303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03fd4d-b149-4f47-8662-189a3229091b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.703494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9e83-449d-494f-9aef-583db97e653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:42.704054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9e83-449d-494f-9aef-583db97e653e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.704334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9e83-449d-494f-9aef-583db97e653e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.704604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9e83-449d-494f-9aef-583db97e653e None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.705862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9e83-449d-494f-9aef-583db97e653e None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:42.708127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9e83-449d-494f-9aef-583db97e653e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:42.710742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 109/223] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:42 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:42.713607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.714392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.714918 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.738261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:42.739499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:42.782448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03fd4d-b149-4f47-8662-189a3229091b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:42.819727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:42.820369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:42.820661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:42.822506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] PATH_INFO: `/v3/users/9183f1c669b5405a9001d955a9cc5d31` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:42.845682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] RBAC: Authorizing `identity:get_user(user_id=9183f1c669b5405a9001d955a9cc5d31)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:42.848016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:42.850958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 115/224] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:42 2022] GET /identity/v3/users/9183f1c669b5405a9001d955a9cc5d31 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:42.853504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.864801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 110/225] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:42.871722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:42.911729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:42.975604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3290ef-3938-4849-972c-af6d8e62dfee None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.003740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:43.016759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.017718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.021044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.021044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/95f0d18881c4494bb7487bda7c397e58/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.021044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1063a44f50243cfb7c8dd23be5b4d91, user_id=95f0d18881c4494bb7487bda7c397e58, role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:43.022664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:43.051380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbafd67-6c8c-4286-9571-b50136405196 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.094374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 116/226] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:42 2022] PUT /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/95f0d18881c4494bb7487bda7c397e58/roles/17bb4391783f400d995fb75b6e3f4684 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:43.097734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479519-6638-4108-833f-35c99654c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.098456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479519-6638-4108-833f-35c99654c706 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.098880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479519-6638-4108-833f-35c99654c706 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.099223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479519-6638-4108-833f-35c99654c706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.186850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479519-6638-4108-833f-35c99654c706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:43.188366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479519-6638-4108-833f-35c99654c706 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:43.238817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:43.264721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:43.318977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 111/227] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:43.336250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479519-6638-4108-833f-35c99654c706 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:43.394740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff0c4-4a33-4ebd-800c-e20fb6aec153 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.403968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:43.434858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.435788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.436242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.436657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.448496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:43.453600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:43.454733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:43.455573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:43.456183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479519-6638-4108-833f-35c99654c706 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.458103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 117/228] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:43.463430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:43.494458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.495140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.495509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.495868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.497093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:43.498549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:43.500396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 112/229] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:43 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:43.506515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:43.559097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:43.593631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1be419-476f-42b2-a7c0-4af9d396b3e8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.644981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.645601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.645881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.646156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.649610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:43.650821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:43.652525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:43.663756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52749e1-7fbc-4efb-9654-fbe9fd83cdae None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.674962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 118/230] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:43.681269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:43.705538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.706162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.706448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.706758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.707575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=9183f1c669b5405a9001d955a9cc5d31) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:43.707890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:43.709582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5cd43-a148-4fc3-9663-046d15bad2b4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:43.723550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 113/231] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:43 2022] GET /identity/v3/role_assignments?user.id=9183f1c669b5405a9001d955a9cc5d31&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=704ea304308b4c07a422828221278e65 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:43.766044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:43.847651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b5de9-4925-4547-9b56-4f86381de4e4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:43.869950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce140d68-6a10-4d3a-ab08-9456c3e51c03 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.870459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce140d68-6a10-4d3a-ab08-9456c3e51c03 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.870459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce140d68-6a10-4d3a-ab08-9456c3e51c03 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.872521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 114/232] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:43.879054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.879374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.880081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.901933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:43.903196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:43.916052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:43.916717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:43.916998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:43.917274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] PATH_INFO: `/v3/users/95f0d18881c4494bb7487bda7c397e58` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:43.918627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] RBAC: Authorizing `identity:get_user(user_id=95f0d18881c4494bb7487bda7c397e58)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:43.920109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:43.922040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 119/233] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:43 2022] GET /identity/v3/users/95f0d18881c4494bb7487bda7c397e58 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:43.927688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:43.987148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 115/234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:44.098387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:44.105085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd438b-aa5f-4802-bfbc-a40883ebbdfa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:44.155666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:44.156310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:44.156586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:44.156853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:44.163399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:44.164878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:44.166551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 120/235] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:43 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:44.172181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:44.209347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:44.312556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:44.324569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b965a2-cb1d-49f9-820f-ff8a92083b69 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:44.395100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:44.396108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:44.396597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:44.397059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/95f0d18881c4494bb7487bda7c397e58/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:44.399839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] RBAC: Authorizing `identity:create_grant(project_id=c1063a44f50243cfb7c8dd23be5b4d91, user_id=95f0d18881c4494bb7487bda7c397e58, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:44.401532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:44.427290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32429917-153d-40fb-bf50-7f270378b38e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:44.468758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617f91-3b21-48a1-9fe2-4cb41925fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:44.471382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617f91-3b21-48a1-9fe2-4cb41925fe1d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:44.471382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617f91-3b21-48a1-9fe2-4cb41925fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:44.471382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617f91-3b21-48a1-9fe2-4cb41925fe1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:44.483411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab617f91-3b21-48a1-9fe2-4cb41925fe1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ab617f91-3b21-48a1-9fe2-4cb41925fe1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:44.488386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:44.494186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 121/236] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:44.495203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164969bf-5a68-4d99-a2e3-e9ce23ec2c56 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:44.495911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164969bf-5a68-4d99-a2e3-e9ce23ec2c56 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:44.495911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164969bf-5a68-4d99-a2e3-e9ce23ec2c56 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:44.495911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 122/237] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:44.502978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:44.503292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:44.503504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:44.503928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 116/238] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:44 2022] PUT /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/95f0d18881c4494bb7487bda7c397e58/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:44.504512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:44.530727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:44.533129 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:44.559253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:44.633009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 123/239] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:44.743905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:44.764072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5d93-922d-41fa-be75-40f48c8f92cd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:44.807228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:44.808052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:44.808721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:44.808988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:44.809677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:44.809978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:44.811567 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:44.822072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 117/240] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:44.827610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:44.968200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:44.982578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f3589-d4ff-4079-b1ce-d4ad6c1248d1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:45.029084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:45.029653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.029929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.030207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] PATH_INFO: `/v3/users/4f1acf6364a743969d42faa2e9f7a16e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.060162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1acf6364a743969d42faa2e9f7a16e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:45.061649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:45.063694 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 124/241] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:44 2022] GET /identity/v3/users/4f1acf6364a743969d42faa2e9f7a16e => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:45.071141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:45.089934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:45.205000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11c7a5-57f2-4bfe-a2d1-863780ffedb5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:45.229126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4893f-98c9-4bb7-954a-2a05b3fc0228 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:45.271788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:45.272430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.272706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.272972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.275020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:45.276700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:45.278288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 118/242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:45.284419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:45.303562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:45.315294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0636b9-310e-46c8-86a3-5188cf40acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:45.315995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0636b9-310e-46c8-86a3-5188cf40acfa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.316272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0636b9-310e-46c8-86a3-5188cf40acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.316545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0636b9-310e-46c8-86a3-5188cf40acfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.445770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0636b9-310e-46c8-86a3-5188cf40acfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:45.448008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0636b9-310e-46c8-86a3-5188cf40acfa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:45.452506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c831a41-b1f2-4a4d-95f4-6108655240d3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:45.469323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:45.501536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5f2e1-2cb4-46f2-93a7-b3e9c93cc209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:45.502142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f2e1-2cb4-46f2-93a7-b3e9c93cc209 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.502434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f2e1-2cb4-46f2-93a7-b3e9c93cc209 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.502772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f2e1-2cb4-46f2-93a7-b3e9c93cc209 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.503438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5f2e1-2cb4-46f2-93a7-b3e9c93cc209 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:45.504971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5f2e1-2cb4-46f2-93a7-b3e9c93cc209 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:45.569330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 125/243] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:45.571422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c44d-fd95-4d5c-b61f-bad99693f444 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.572076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c44d-fd95-4d5c-b61f-bad99693f444 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.572551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c44d-fd95-4d5c-b61f-bad99693f444 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.574233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 126/244] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:45.575425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c44d-fd95-4d5c-b61f-bad99693f444 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:45.579115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 119/245] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:45 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:45.581002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.581230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.581512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.602737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:45.604416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:45.679132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:45.686099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 120/246] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:45.696724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c44d-fd95-4d5c-b61f-bad99693f444 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:45.711969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:45.735468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:45.736413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.736855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.737330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.738666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:45.740383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:45.742384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 127/247] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:45 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:45.749242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:45.879398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abf61-f588-4490-be18-a828d2060172 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:45.916430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:45.917331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:45.917785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:45.918229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:45.919196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] RBAC: Adding query filter params (role.id=3232e1e490914d778785be7b1c3c0090, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=4f1acf6364a743969d42faa2e9f7a16e) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:45.919678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:45.921399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b7ecf-0f4d-43d2-a6e6-c29a0acf0e7f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:45.927947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 121/248] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:45 2022] GET /identity/v3/role_assignments?user.id=4f1acf6364a743969d42faa2e9f7a16e&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=3232e1e490914d778785be7b1c3c0090 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:46.056031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:46.087363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6d23-3eaf-4042-9e0e-4376b74199ab None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.088357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6d23-3eaf-4042-9e0e-4376b74199ab None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.088790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6d23-3eaf-4042-9e0e-4376b74199ab None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.090320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 122/249] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:46.095860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.096485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.096950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.126124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:46.127387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:46.184833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a11ce-4c55-471f-8605-8c4eeda4b680 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:46.202195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:46.214251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 123/250] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:46.221510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:46.222149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.222430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.222718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.234381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:46.239759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:46.240891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:46.241663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 128/251] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:18:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:46.247361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:46.366444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94db92-22bd-4a38-a4f4-15d66d1977c6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:46.408342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:46.409244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.409788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.410268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.411142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:46.411618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:46.413176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:46.422816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 124/252] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:18:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:46.429070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:46.489008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:46.557265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e108b3-91f5-42fa-bec2-6c0af1cbbf28 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:46.577981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:46.605269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:46.605269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.605269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.605269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] PATH_INFO: `/v3/users/95f0d18881c4494bb7487bda7c397e58` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.606960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] RBAC: Authorizing `identity:get_user(user_id=95f0d18881c4494bb7487bda7c397e58)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:46.608959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:46.609717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 129/253] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:46 2022] GET /identity/v3/users/95f0d18881c4494bb7487bda7c397e58 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:46.617599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:46.675314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:46.777155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7d06-c2af-4fa2-bb1c-0db41d9f789b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:46.777935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd72c-d226-4dc9-b151-db7cfdc2ba0a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:46.788709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:46.822808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9552b1-5e0c-4cf8-b897-461c3e656aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:46.824438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9552b1-5e0c-4cf8-b897-461c3e656aec None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.826255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9552b1-5e0c-4cf8-b897-461c3e656aec None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.826786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9552b1-5e0c-4cf8-b897-461c3e656aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.879533 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:46.880289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:46.880627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:46.880944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:46.904911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:46.910179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:46.911060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:46.911859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:46.915359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 125/254] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:46.919476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:47.015739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9552b1-5e0c-4cf8-b897-461c3e656aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:47.017558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9552b1-5e0c-4cf8-b897-461c3e656aec None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:47.140959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f0cd2-6eae-4f15-a0a1-6bd290cec921 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:47.158507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:47.194317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 130/255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:47.195885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08236c-a6ab-4683-b593-493ffd940fef None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.196176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08236c-a6ab-4683-b593-493ffd940fef None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.196692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08236c-a6ab-4683-b593-493ffd940fef None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.198406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 131/256] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:47.201393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:47.201528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08236c-a6ab-4683-b593-493ffd940fef None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:47.202020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.202300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.202570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.203305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:47.203611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:47.206239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff386dd-3a89-44c0-97bc-70c6623efbba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:47.220462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:47.228117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 126/257] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:47.229396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.229682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.229956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.270750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:47.272125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:47.375620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 127/258] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:47.377550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:47.423634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08236c-a6ab-4683-b593-493ffd940fef None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:47.481332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:47.481980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.482303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.482579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.485084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:47.486667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:47.488431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 132/259] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:47 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:47.495146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:47.575745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04237bb6-6cbf-49a5-ade3-337d9e3bcd85 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:47.588867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:47.646294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:47.646970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.647254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.647528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] PATH_INFO: `/v3/users/9183f1c669b5405a9001d955a9cc5d31` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.651417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] RBAC: Authorizing `identity:get_user(user_id=9183f1c669b5405a9001d955a9cc5d31)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:47.652895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:47.654712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 128/260] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:47 2022] GET /identity/v3/users/9183f1c669b5405a9001d955a9cc5d31 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:47.659981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:47.693165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:47.745630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e226-69ed-44d7-8955-83f0ecce6b52 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:47.816705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:47.817650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.817939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.818212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.819733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] RBAC: Adding query filter params (role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=95f0d18881c4494bb7487bda7c397e58) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:47.820052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:47.822113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:47.836725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 133/261] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:47 2022] GET /identity/v3/role_assignments?user.id=95f0d18881c4494bb7487bda7c397e58&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:47.837854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:47.876789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca035c1-fe01-48f5-8626-fa7f540aeefb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:47.922505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:47.923197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:47.923473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:47.923738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:47.925150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:47.926646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:47.928564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 129/262] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:47 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:47.940166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:48.011470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:48.037437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddd9a6-876d-4917-9d86-43e428d18450 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:48.078830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc66ef-b385-4c8f-8e13-58af0622534c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:48.103481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:48.104244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.104623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.104975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.118060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:48.120264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:48.121921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.122402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.122886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/9183f1c669b5405a9001d955a9cc5d31/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.125159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:48.125434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] RBAC: Authorizing `identity:create_grant(project_id=c1063a44f50243cfb7c8dd23be5b4d91, user_id=9183f1c669b5405a9001d955a9cc5d31, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:48.127308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:48.130951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:48.135517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:18:48.136303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:48.139022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 134/263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:48.142434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:48.204354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 130/264] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:47 2022] PUT /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/9183f1c669b5405a9001d955a9cc5d31/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:48.287268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676155-206e-48d1-8f40-1e21e6a013f9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:48.328235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:48.329214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.329688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.330168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.331064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:48.331560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:48.333247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:48.343192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 135/265] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:48.349224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:48.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fccd1-7013-40ea-a692-82bf5c06b7ed None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:48.509866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:48.543576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c03fc-67cf-4c80-a454-083e852983c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:48.544143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c03fc-67cf-4c80-a454-083e852983c2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.544422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c03fc-67cf-4c80-a454-083e852983c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.544692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c03fc-67cf-4c80-a454-083e852983c2 None admin] PATH_INFO: `/v3/users/95f0d18881c4494bb7487bda7c397e58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.545860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c03fc-67cf-4c80-a454-083e852983c2 None admin] RBAC: Authorizing `identity:get_user(user_id=95f0d18881c4494bb7487bda7c397e58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:48.547354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c03fc-67cf-4c80-a454-083e852983c2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:48.548942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 131/266] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:48 2022] GET /identity/v3/users/95f0d18881c4494bb7487bda7c397e58 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:48.556811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:48.574275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662c7b-08a4-42b7-b2e3-ded9255abbdd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.575180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662c7b-08a4-42b7-b2e3-ded9255abbdd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.575857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662c7b-08a4-42b7-b2e3-ded9255abbdd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.577904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 132/267] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:48.583700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.583952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.584197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.608867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:48.610505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:48.641299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:48.690372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 133/268] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:48.718648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0cc3e-017c-4e32-abbc-660cc72344a0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:48.766432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e9ab-cecf-417a-acb4-16d0876cb5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:48.767084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e9ab-cecf-417a-acb4-16d0876cb5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.767359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e9ab-cecf-417a-acb4-16d0876cb5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.767632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e9ab-cecf-417a-acb4-16d0876cb5d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.840210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793e9ab-cecf-417a-acb4-16d0876cb5d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:48.841598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793e9ab-cecf-417a-acb4-16d0876cb5d9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:48.911973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:48.964101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 136/269] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:48.969834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:48.971145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef551ee-80f5-449a-9b2b-81077202985d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.971433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef551ee-80f5-449a-9b2b-81077202985d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.971705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef551ee-80f5-449a-9b2b-81077202985d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:48.973406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 137/270] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:48.986712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:48.986712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:48.986712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.000275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:49.002299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:49.083261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 138/271] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:49.084194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.100198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:49.103872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea45788-0f8f-4a09-801e-bf567b16aacc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.142663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.143785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.144274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.144766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.146132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:49.147854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:49.150598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 134/272] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:48 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:49.156961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.222640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:49.232115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26917b0-6aa8-41df-ab20-6f705221de62 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.266375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cdba6-e35b-49bb-986c-3aa79e67424b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.270208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2bdb6-8e60-4ea2-95a3-201424a544d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.270822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2bdb6-8e60-4ea2-95a3-201424a544d5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.271174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2bdb6-8e60-4ea2-95a3-201424a544d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.271514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2bdb6-8e60-4ea2-95a3-201424a544d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.282939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2bdb6-8e60-4ea2-95a3-201424a544d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-05a2bdb6-8e60-4ea2-95a3-201424a544d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:49.287929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:49.288946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:49.290305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 139/273] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:49.290976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f092e4-0475-4215-ad21-dc82ab3e4f64 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.290976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f092e4-0475-4215-ad21-dc82ab3e4f64 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.296492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f092e4-0475-4215-ad21-dc82ab3e4f64 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.296492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 140/274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:49.298494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f092e4-0475-4215-ad21-dc82ab3e4f64 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.316682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.317661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.318158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.318640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.319624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=95f0d18881c4494bb7487bda7c397e58) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:49.320176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:49.322916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a7ffa-e194-42ec-b47a-22288000f7ff None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:49.329777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 135/275] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/role_assignments?user.id=95f0d18881c4494bb7487bda7c397e58&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:49.331433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.331921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.332458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.354196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:49.355976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:49.399194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:49.422061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f092e4-0475-4215-ad21-dc82ab3e4f64 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.436893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 136/276] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:49.472775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.484309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.484946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.485226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.485501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.486192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:49.486495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:49.487964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:49.499106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 141/277] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:49.515214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.547190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:49.633428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb512bd-b901-4d30-89d5-23783754b7c2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.654527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c580-23f6-4007-85c6-94c757d65e9d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.675898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.676639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.676926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.677196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.691523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:49.697185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.697867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:49.698070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:49.698939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:49.700350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:49.700937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.700937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] PATH_INFO: `/v3/users/4f1acf6364a743969d42faa2e9f7a16e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.701063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 137/278] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:49.704336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1acf6364a743969d42faa2e9f7a16e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:49.705034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.705615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:49.707311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 142/279] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/users/4f1acf6364a743969d42faa2e9f7a16e => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:49.715727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.737435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:49.827395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:49.846812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8413e-0378-47f1-98d3-4eac5f96ebe3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.847497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f0c8b-bf8c-4074-b2c1-d62bb26d842e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:49.882178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.882809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.883718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.884102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.884779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:49.885083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:49.885175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:49.885747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:49.886027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:49.886299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:49.886474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:49.887708 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:49.889145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:49.890966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 143/280] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:49.900949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 138/281] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:49.901097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.901173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:49.988486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:50.010298 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a070ef-7d68-4db2-b757-8911495e796d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:50.011437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9148-d436-4a44-9b4f-2204641ae601 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:50.048048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:50.048726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.049012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.049283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/4f1acf6364a743969d42faa2e9f7a16e/roles/3232e1e490914d778785be7b1c3c0090` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.051271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1063a44f50243cfb7c8dd23be5b4d91, user_id=4f1acf6364a743969d42faa2e9f7a16e, role_id=3232e1e490914d778785be7b1c3c0090)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:50.052734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:50.054807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:50.055734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.056017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.056522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.057431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:50.058877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:50.060502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 144/282] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:50.061283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:50.081545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:50.127709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 139/283] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:18:49 2022] PUT /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/users/4f1acf6364a743969d42faa2e9f7a16e/roles/3232e1e490914d778785be7b1c3c0090 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:50.128934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:50.196975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee907ce-fcda-4a57-8495-8339c45433fa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:50.240558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:50.241322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.241670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.241956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] PATH_INFO: `/v3/users/e96d23763a22495dba8747d45fd65256` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.260940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] RBAC: Authorizing `identity:get_user(user_id=e96d23763a22495dba8747d45fd65256)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:50.262741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:50.266738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 145/284] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:50 2022] GET /identity/v3/users/e96d23763a22495dba8747d45fd65256 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:50.270821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:50.279601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e64f8-b1bc-4d7b-973f-6c15fe099d29 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:50.331186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b78f3f-03e5-47b0-9eab-284b99f5bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:50.332419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78f3f-03e5-47b0-9eab-284b99f5bc4a None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.333403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78f3f-03e5-47b0-9eab-284b99f5bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.333832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78f3f-03e5-47b0-9eab-284b99f5bc4a None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.335008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b78f3f-03e5-47b0-9eab-284b99f5bc4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:50.337848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b78f3f-03e5-47b0-9eab-284b99f5bc4a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:50.366348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:50.392521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d29a-eb4a-4c5c-937c-6858945d300a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:50.421514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:50.435075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 140/285] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:18:50 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:50.439963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:50.440605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.440929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.441254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.442007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, user.id=e96d23763a22495dba8747d45fd65256, scope.system=all) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:50.442416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:50.444155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95127-cc9a-4e80-b6bb-96b551ce6a55 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:50.451220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 146/286] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 05:18:50 2022] GET /identity/v3/role_assignments?user.id=e96d23763a22495dba8747d45fd65256&scope.system=all&role.id=704ea304308b4c07a422828221278e65 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:50.671792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6b51-ed7d-4878-8182-9fce2893e295 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.672233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6b51-ed7d-4878-8182-9fce2893e295 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.672600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6b51-ed7d-4878-8182-9fce2893e295 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.674202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 141/287] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:50.679852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:50.680427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:50.680688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:50.700275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:50.701753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:50.782863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 147/288] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:51.069694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b6b51-ed7d-4878-8182-9fce2893e295 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:51.195059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b6b51-ed7d-4878-8182-9fce2893e295 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:51.233739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:51.234377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:51.234661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:51.234967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:51.246961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:51.252445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:51.253333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:51.254148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 142/289] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:51.260538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:51.356746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:51.391074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ecdeb-32de-40a5-ba03-c280f3c61473 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:51.448361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:51.448991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:51.449277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:51.449551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:51.450229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:51.450533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:51.452025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:51.463319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 148/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:51.468922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:51.572647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:51.642529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96474ed1-3843-489a-8618-66abc34e3c73 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:51.696755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:51.697392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:51.697673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:51.697946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] PATH_INFO: `/v3/users/9183f1c669b5405a9001d955a9cc5d31` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:51.703369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] RBAC: Authorizing `identity:get_user(user_id=9183f1c669b5405a9001d955a9cc5d31)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:51.704850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:51.706765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 143/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:51 2022] GET /identity/v3/users/9183f1c669b5405a9001d955a9cc5d31 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:51.712787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:51.865423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6a38c-9618-4268-834d-5fee17f93bbf None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:51.903238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:51.908298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:51.908917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:51.909197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:51.909472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.001340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:52.002846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:52.127424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 149/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:52.132898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:52.289149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6d786-4b51-4ebc-be94-7e24c3cc7d91 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:52.321994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:52.330245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050822-333d-4d3c-a05d-e078f047ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:52.330922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050822-333d-4d3c-a05d-e078f047ef66 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.331206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050822-333d-4d3c-a05d-e078f047ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.331481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050822-333d-4d3c-a05d-e078f047ef66 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.332641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68050822-333d-4d3c-a05d-e078f047ef66 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:52.334123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68050822-333d-4d3c-a05d-e078f047ef66 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:52.336210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 144/293] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:52 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:52.341966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:52.399372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:52.500792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2d7d8-8d0d-49b0-8730-d50d2a74cad6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:52.544570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:52.545103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.545382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.545646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.546373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=9183f1c669b5405a9001d955a9cc5d31) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:52.546676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:52.548127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d99bf-db5d-4367-ba26-c2204dd8a8fc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:52.559382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 150/294] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:52 2022] GET /identity/v3/role_assignments?user.id=9183f1c669b5405a9001d955a9cc5d31&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=704ea304308b4c07a422828221278e65 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:52.638297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09809fe-a0f4-489c-9c41-33ab82586e7f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.638855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09809fe-a0f4-489c-9c41-33ab82586e7f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.638855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09809fe-a0f4-489c-9c41-33ab82586e7f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.640566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 145/295] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:52.646437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e78d4-d656-429c-831d-85d1bbf31faf None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.646801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e78d4-d656-429c-831d-85d1bbf31faf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.647012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e78d4-d656-429c-831d-85d1bbf31faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.676521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e77e78d4-d656-429c-831d-85d1bbf31faf None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:52.677738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e77e78d4-d656-429c-831d-85d1bbf31faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:52.719190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9f6c-4990-4c16-8a25-906128555fbc None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.719548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9f6c-4990-4c16-8a25-906128555fbc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.719744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9f6c-4990-4c16-8a25-906128555fbc None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.721149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 146/296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:52.730446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834b27-063c-4ab5-8747-e72ef6208d3f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.730763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834b27-063c-4ab5-8747-e72ef6208d3f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.731047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834b27-063c-4ab5-8747-e72ef6208d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.771720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-29834b27-063c-4ab5-8747-e72ef6208d3f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:52.772932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-29834b27-063c-4ab5-8747-e72ef6208d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:52.776543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 151/297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:52.852667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 147/298] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:52.991938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adb618-e545-4418-99fb-2db3530bc067 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:52.992348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adb618-e545-4418-99fb-2db3530bc067 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:52.992593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adb618-e545-4418-99fb-2db3530bc067 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:52.994544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 152/299] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:53.000007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.000356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.000631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.024194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:53.025376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:53.099407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adb618-e545-4418-99fb-2db3530bc067 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.107035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 148/300] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:53.134092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.136474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.207223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.242230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adb618-e545-4418-99fb-2db3530bc067 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.258718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58926-9455-4358-a1ce-63615a791fdc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.284873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.285834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.286286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.286843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.299053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:53.304304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:53.305813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:53.306604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:53.307237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.307237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.307237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.307237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.309577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 153/301] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:53.318558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.318761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:53.324911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:53.325967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:53.326776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:53.328892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 149/302] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:53.335454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.424895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.439715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c069a7-6224-48d9-b4ff-1968e7fc362e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.451702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0d14-5621-4516-b2f0-3b896d77545d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.468691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.474622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.479996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.479996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.479996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.479996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:53.479996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:53.479996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ac2c4-3972-4ba7-8d1a-ebcd39bbd78e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:53.486312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.486943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.487218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.487321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 154/303] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:53.487488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.488148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:53.488518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06547849-d0a8-4396-83d7-3f029515d9a6 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.488608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:53.488813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06547849-d0a8-4396-83d7-3f029515d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.489093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06547849-d0a8-4396-83d7-3f029515d9a6 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.489898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:53.494586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 155/304] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:53.494586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06547849-d0a8-4396-83d7-3f029515d9a6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.502143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 150/305] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:53.503670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.594220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06547849-d0a8-4396-83d7-3f029515d9a6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.605851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945938fb-ebac-4022-93fa-d85c5f850fa8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.630301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.630956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.631236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.631501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.641375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f337a-4323-4757-a945-66f86c2c7af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.641875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:53.642015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f337a-4323-4757-a945-66f86c2c7af8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.642296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f337a-4323-4757-a945-66f86c2c7af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.642568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f337a-4323-4757-a945-66f86c2c7af8 None admin] PATH_INFO: `/v3/users/4f1acf6364a743969d42faa2e9f7a16e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.643730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f337a-4323-4757-a945-66f86c2c7af8 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1acf6364a743969d42faa2e9f7a16e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:53.645191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f337a-4323-4757-a945-66f86c2c7af8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:53.647853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 151/306] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/users/4f1acf6364a743969d42faa2e9f7a16e => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:53.647956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:53.648803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:53.649577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:53.650166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.650240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 156/307] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:53.650307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.650307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.650420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.663665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.668711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:53.674416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:53.712663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.742772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 152/308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:53.742772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.752882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19c2c-cadc-4aaa-b19d-a4f640753953 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.790618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.791313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.791572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.791848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] PATH_INFO: `/v3/users/e96d23763a22495dba8747d45fd65256` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.793025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] RBAC: Authorizing `identity:get_user(user_id=e96d23763a22495dba8747d45fd65256)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:53.794482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:53.796138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 157/309] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/users/e96d23763a22495dba8747d45fd65256 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:53.796900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.852218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f4ce1-713d-4d6a-ad14-02b84aaa9491 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.877403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.890990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.891600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.891967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.892159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.901950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8117d-2597-4fcc-a52b-e1140cdef13b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:53.938229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:53.938878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:53.939159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:53.939433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:53.940091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:53.940392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:53.941752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:53.942000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:53.954877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 158/310] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:53.954877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:53.970407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:53.971916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.056536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306f9e-f6fe-4394-872d-a18e3dc4fee1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.079261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 153/311] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:54.080109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:54.089606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.090257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.090535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.090839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] PATH_INFO: `/v3/system/users/e96d23763a22495dba8747d45fd65256/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.092240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e96d23763a22495dba8747d45fd65256, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.093591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.161801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:54.174144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 159/312] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Aug 24 05:18:53 2022] PUT /identity/v3/system/users/e96d23763a22495dba8747d45fd65256/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:18:54.175055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:54.177995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:54.188789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edab57-3c9f-4799-948b-7cb108e9e321 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.232138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.232714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.232999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.233266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] PATH_INFO: `/v3/users/24c903c723f9400b93da6da570490f68` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.249697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=24c903c723f9400b93da6da570490f68)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.251253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.253346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 154/313] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:54 2022] GET /identity/v3/users/24c903c723f9400b93da6da570490f68 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:54.254279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:54.309506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d98af-a391-4ee8-a2e7-54845574e2c6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.357245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.357887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.358170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.358443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.359702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.361266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.366858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 160/314] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:54.366858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:54.374814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb1105-5a57-4312-9180-d3dc19995dd7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.414930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.415591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.415869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.416140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.418060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.419560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.421205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 155/315] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:18:54 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:54.421955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:54.424759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:54.453515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:54.490305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e35b5-2f95-4bb8-9a4a-ee267545d47f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.528750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.529362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.529646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.529920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.530655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] RBAC: Adding query filter params (role.id=3232e1e490914d778785be7b1c3c0090, user.id=24c903c723f9400b93da6da570490f68, scope.system=all) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:54.531002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.531873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c91189-acbd-4f8b-9cae-bb70e3f398e4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.532434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.538008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 161/316] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 05:18:54 2022] GET /identity/v3/role_assignments?user.id=24c903c723f9400b93da6da570490f68&scope.system=all&role.id=3232e1e490914d778785be7b1c3c0090 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:54.538827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:54.580242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ddff0-d148-4319-a342-b93104302bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.581301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ddff0-d148-4319-a342-b93104302bf5 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.581905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ddff0-d148-4319-a342-b93104302bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.582257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ddff0-d148-4319-a342-b93104302bf5 None admin] PATH_INFO: `/v3/groups` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.583042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ddff0-d148-4319-a342-b93104302bf5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.584719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ddff0-d148-4319-a342-b93104302bf5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.667032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 156/317] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Aug 24 05:18:54 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:18:54.686797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa89b-610f-4bb3-aff3-1791eaf55d4b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:54.732190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:54.732900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:54.733222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:54.733534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:54.734360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] RBAC: Adding query filter params (role.id=3232e1e490914d778785be7b1c3c0090, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91, user.id=4f1acf6364a743969d42faa2e9f7a16e) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:54.734657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:54.736232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee379f-e141-4a7b-9403-6f6420e59671 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:54.738647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:54.744862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 162/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:18:54 2022] GET /identity/v3/role_assignments?user.id=4f1acf6364a743969d42faa2e9f7a16e&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=3232e1e490914d778785be7b1c3c0090 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:56.088978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d077a-483b-44a8-b73e-b0f68f152bbe None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.089546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d077a-483b-44a8-b73e-b0f68f152bbe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.089546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d077a-483b-44a8-b73e-b0f68f152bbe None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.090920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 157/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:56.096191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef788-35b8-439a-b964-64bc15740c20 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.096599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef788-35b8-439a-b964-64bc15740c20 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.096763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef788-35b8-439a-b964-64bc15740c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-aacef788-35b8-439a-b964-64bc15740c20 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:56.117936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aacef788-35b8-439a-b964-64bc15740c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:56.188349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:56.452947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d077a-483b-44a8-b73e-b0f68f152bbe None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:56.519038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:56.520944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e335-d676-43da-9b25-5fda9a429b8f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.521289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e335-d676-43da-9b25-5fda9a429b8f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.521645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e335-d676-43da-9b25-5fda9a429b8f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.526744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 164/321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:56.529019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.529367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.529704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.547300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:56.549756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:56.563507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d077a-483b-44a8-b73e-b0f68f152bbe None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:56.605294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191130ca-71b4-4052-82dd-48afbc825853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:56.605948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191130ca-71b4-4052-82dd-48afbc825853 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.606233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191130ca-71b4-4052-82dd-48afbc825853 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.606506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191130ca-71b4-4052-82dd-48afbc825853 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.619776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191130ca-71b4-4052-82dd-48afbc825853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:56.624026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 165/322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-191130ca-71b4-4052-82dd-48afbc825853 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:56.628025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:56.628883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:18:56.630333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 158/323] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:18:56.635559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:56.660459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff1a9-3996-44f9-81c9-761ea6a44720 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.660800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff1a9-3996-44f9-81c9-761ea6a44720 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.661008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff1a9-3996-44f9-81c9-761ea6a44720 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.662493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 159/324] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:18:56.668731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.669093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.669454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.689847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:56.691110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:56.702048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:56.746809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e152bd-5e74-4333-9eaa-e5ce6075ef22 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:56.764438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 160/325] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:18:56.786815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:56.787428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.787705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.787977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.788636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:56.788970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:56.790591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:56.800140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 166/326] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:56.805632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:56.860306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:56.897521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:56.910738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e6f0-d504-45a9-9164-e4b954e2bfe0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:56.947152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:56.947782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:56.948059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:56.948330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] PATH_INFO: `/v3/users/e96d23763a22495dba8747d45fd65256` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:56.949458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e96d23763a22495dba8747d45fd65256)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:56.950947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:56.952513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 161/327] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:56 2022] GET /identity/v3/users/e96d23763a22495dba8747d45fd65256 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:56.958342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:57.005562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad734-b146-4b7c-b625-aee6496899bf None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.028348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:57.044200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.044828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.045106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.045375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.056227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:18:57.060905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:18:57.061952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 167/328] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:18:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:18:57.063001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:57.069834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5468f-1f55-49a2-8859-63ec31ae86b9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.091357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:57.104852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.105451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.105729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.106000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.106781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] RBAC: Adding query filter params (role.id=704ea304308b4c07a422828221278e65, user.id=e96d23763a22495dba8747d45fd65256, scope.system=all) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:57.107094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:57.108621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:57.120930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 162/329] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 05:18:56 2022] GET /identity/v3/role_assignments?user.id=e96d23763a22495dba8747d45fd65256&scope.system=all&role.id=704ea304308b4c07a422828221278e65 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:57.121737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:57.189670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593942-d301-4121-8bbb-8e3414a6251e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.234153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.234866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.235151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.235428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.236682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:57.238216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:57.239948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 168/330] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:18:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:57.246354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:57.247693 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c078c81-0a53-4c0f-9b72-b8c4775aa933 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.292077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.292610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.292897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.293220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.293905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:18:57.294205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:57.295649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:57.306033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 163/331] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:18:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:18:57.313141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:57.315121 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:57.357344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:57.372987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc84bb5-cb3d-41af-b7a2-ae7e358ab285 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.408098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94e5e-73e0-4383-8327-3507eea39c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.409147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94e5e-73e0-4383-8327-3507eea39c16 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.409659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94e5e-73e0-4383-8327-3507eea39c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.410157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94e5e-73e0-4383-8327-3507eea39c16 None admin] PATH_INFO: `/v3/groups` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.411476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b94e5e-73e0-4383-8327-3507eea39c16 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:57.414830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b94e5e-73e0-4383-8327-3507eea39c16 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:57.418784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6866b-1bdf-4501-98e9-a4e9c1ee201b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.453038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.453668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.453946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.454219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] PATH_INFO: `/v3/users/24c903c723f9400b93da6da570490f68` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.455369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=24c903c723f9400b93da6da570490f68)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:57.456842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:57.458415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 164/332] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:18:57 2022] GET /identity/v3/users/24c903c723f9400b93da6da570490f68 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:18:57.464414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:18:57.477263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 169/333] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Aug 24 05:18:57 2022] POST /identity/v3/groups => generated 226 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:18:57.575889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4b20-daab-45bc-ac27-aa998f938ee8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:18:57.585682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:57.613151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa49c-d420-49f9-86f1-230d2c288ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:18:57.614595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa49c-d420-49f9-86f1-230d2c288ac5 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:57.614904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa49c-d420-49f9-86f1-230d2c288ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:57.615179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa49c-d420-49f9-86f1-230d2c288ac5 None admin] PATH_INFO: `/v3/system/users/24c903c723f9400b93da6da570490f68/roles/3232e1e490914d778785be7b1c3c0090` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:57.616635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aa49c-d420-49f9-86f1-230d2c288ac5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=24c903c723f9400b93da6da570490f68, role_id=3232e1e490914d778785be7b1c3c0090)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:18:57.618028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aa49c-d420-49f9-86f1-230d2c288ac5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:18:57.682758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 165/334] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Aug 24 05:18:57 2022] PUT /identity/v3/system/users/24c903c723f9400b93da6da570490f68/roles/3232e1e490914d778785be7b1c3c0090 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:18:59.615617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b32e4-2b4d-4ec7-af28-e04f3f17353f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:59.616125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b32e4-2b4d-4ec7-af28-e04f3f17353f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:59.616401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b32e4-2b4d-4ec7-af28-e04f3f17353f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:59.617942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 170/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:59.623889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2f83-a4c8-4e3e-a318-73caf29fbbc1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:59.624364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2f83-a4c8-4e3e-a318-73caf29fbbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:59.624454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2f83-a4c8-4e3e-a318-73caf29fbbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:59.649949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7a3b2f83-a4c8-4e3e-a318-73caf29fbbc1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:59.651209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a3b2f83-a4c8-4e3e-a318-73caf29fbbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:59.742023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 166/336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:18:59.860796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a571823-002b-444c-a8de-db39f1ecc031 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:59.861086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a571823-002b-444c-a8de-db39f1ecc031 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:59.861268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a571823-002b-444c-a8de-db39f1ecc031 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:59.862796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 171/337] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:18:59.870194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a99e8-92ff-4252-8a58-4f359a9607db None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:18:59.870483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a99e8-92ff-4252-8a58-4f359a9607db None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:18:59.870774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a99e8-92ff-4252-8a58-4f359a9607db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:18:59.895766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9b6a99e8-92ff-4252-8a58-4f359a9607db None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:18:59.896984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b6a99e8-92ff-4252-8a58-4f359a9607db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:18:59.989702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 167/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:19:00.000940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60cc9-64f0-42ce-884d-a90335fd26d9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.001233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60cc9-64f0-42ce-884d-a90335fd26d9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.001491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60cc9-64f0-42ce-884d-a90335fd26d9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.006074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 172/339] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:00.012317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.012606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.012881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.039985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:00.041203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:00.070877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:00.125983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 168/340] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:00.225243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60cc9-64f0-42ce-884d-a90335fd26d9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:00.365240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60cc9-64f0-42ce-884d-a90335fd26d9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:00.375893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:00.400163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:00.411433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:00.412091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.412372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.412646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.430157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:00.435397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:00.436316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:00.437734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 173/341] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:00.443747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:00.568422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667eac-e243-4b89-90a8-c8c7ec12c765 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:00.588588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378cd65-5703-40fe-8cee-a87c6e54d1df None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:00.613382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ab63-c73c-4c28-a73a-aa803b102339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:00.614450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ab63-c73c-4c28-a73a-aa803b102339 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.614951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ab63-c73c-4c28-a73a-aa803b102339 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.615524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ab63-c73c-4c28-a73a-aa803b102339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.630350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953ab63-c73c-4c28-a73a-aa803b102339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3953ab63-c73c-4c28-a73a-aa803b102339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:00.637692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:00.638571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:00.639401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:00.648823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 169/342] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:00.650650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e665df-75ae-4647-9fab-a1fcf077dac8 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.653913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e665df-75ae-4647-9fab-a1fcf077dac8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.654989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e665df-75ae-4647-9fab-a1fcf077dac8 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.655818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:00.657751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 170/343] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:00.658635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.659233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.660259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e665df-75ae-4647-9fab-a1fcf077dac8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:00.660763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.661677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:00.662730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:00.664865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3fde-eaf1-4155-8f65-fe57a0e34299 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:00.691723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 174/344] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:00.693581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.694072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.696185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.715715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:00.728096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:00.729609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:00.759707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:00.815321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 175/345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:00.816742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:00.842628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e665df-75ae-4647-9fab-a1fcf077dac8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:00.904682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:00.905687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.906180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.906642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:00.907556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:00.908117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:00.914741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:00.928542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 171/346] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:00.930437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:00.931564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf5f9-0f9f-4680-9841-baa52eea0f23 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:00.970911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:00.971534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:00.971821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:00.972094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.002884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.053568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:01.055504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:01.088097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.115526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234c2a-dec3-4090-9aea-4425f7b4adb1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.163260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 176/347] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:01.164646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.190773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478698-a495-4767-8720-bed723adf50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.191828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478698-a495-4767-8720-bed723adf50c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.192301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478698-a495-4767-8720-bed723adf50c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.192766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478698-a495-4767-8720-bed723adf50c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.217359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01478698-a495-4767-8720-bed723adf50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-01478698-a495-4767-8720-bed723adf50c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:01.223357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:01.224328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:01.225529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 172/348] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:01.226738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478698-a495-4767-8720-bed723adf50c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.271090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.341514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b46b-dc81-4468-b173-218bda3eace3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.374562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478698-a495-4767-8720-bed723adf50c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.387395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.388018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.388300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.388589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.414225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.415286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.415780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.416244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.417615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:01.419294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:01.421239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 173/349] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:01.422402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.439985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.472488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:01.473947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:01.535016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64044b05-0e30-47b7-9cdd-68e479941548 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.555435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.573349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.574326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.574830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.575296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.576256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:01.576752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:01.578394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:01.589808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 174/350] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:01.591069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.597566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 177/351] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:01.598507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.689806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.721109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3003-9dd7-4d14-a28d-b9b018bc3910 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.726907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219d8ab-78ee-4996-acf9-d79f3e71a8fb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.763853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.764482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.764771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.765093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.774045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.774990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.775273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.775545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.777553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:01.782888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:01.783804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:01.784595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 175/352] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:01.785240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:01.785309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.785844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:01.787746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 178/353] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:01.788527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.827720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:01.939064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b9b94-2851-4b13-8a56-89dffaee85c2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.940143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3298987-5e08-4f72-8ff0-5b0456cb4bfb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:01.981276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb5c88-b08d-47e2-bfb5-dc4c396f3c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.981507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:01.981938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.982042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5c88-b08d-47e2-bfb5-dc4c396f3c25 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.982193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.982299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5c88-b08d-47e2-bfb5-dc4c396f3c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.982443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.982532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5c88-b08d-47e2-bfb5-dc4c396f3c25 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.984613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb5c88-b08d-47e2-bfb5-dc4c396f3c25 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:01.986196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb5c88-b08d-47e2-bfb5-dc4c396f3c25 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:01.988362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 176/354] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:01.989535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0d64-d485-4ece-910e-192a8626d313 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:01.989812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0d64-d485-4ece-910e-192a8626d313 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:01.990083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0d64-d485-4ece-910e-192a8626d313 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:01.991573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 177/355] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:01.992472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0d64-d485-4ece-910e-192a8626d313 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:01.996098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.068270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.070420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.107320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.142402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0d64-d485-4ece-910e-192a8626d313 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:02.193393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:02.193953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.194339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.194610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.195398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:02.195701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.197134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.207863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 178/356] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:02.208770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.221398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 179/357] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:02.222568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.284785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.328956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde756a-c5ba-4e8e-a007-1e95a94cdd49 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:02.349569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83b64-0c28-4144-91ab-d6dee001f233 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:02.376987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:02.377594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.377868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.378567 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.378902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=704ea304308b4c07a422828221278e65, scope.project.id=67330f8be90f496e8bd37bc02087f8ae) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:02.379208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.380693 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312432-fc22-4b6a-989b-9efde8c76f61 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.382247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.388029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 179/358] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=704ea304308b4c07a422828221278e65 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:02.389953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f13f9-be62-4584-af9f-10fc3a4c7cd0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.390235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f13f9-be62-4584-af9f-10fc3a4c7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.390516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f13f9-be62-4584-af9f-10fc3a4c7cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.397471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:02.399040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.399469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.399890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.401455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.404738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.407253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 180/359] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:02.408582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.416090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6e4f13f9-be62-4584-af9f-10fc3a4c7cd0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:02.416695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6e4f13f9-be62-4584-af9f-10fc3a4c7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:02.524940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 180/360] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:02.526462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b175eb-092f-4ef7-af0c-54792b051abc None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.527675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b175eb-092f-4ef7-af0c-54792b051abc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.527675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b175eb-092f-4ef7-af0c-54792b051abc None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.528518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 181/361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:02.529155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b175eb-092f-4ef7-af0c-54792b051abc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.566613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf43f-49dc-48b8-9d65-a6344da3998a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:02.602797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.619243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:02.620386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.620875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.621320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] PATH_INFO: `/v3/users/24c903c723f9400b93da6da570490f68` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.623554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] RBAC: Authorizing `identity:get_user(user_id=24c903c723f9400b93da6da570490f68)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.625209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.627815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 181/362] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/users/24c903c723f9400b93da6da570490f68 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:02.628866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.671476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b175eb-092f-4ef7-af0c-54792b051abc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:02.699640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.723797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0005da-cd1c-407b-86b5-ff63691bcddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:02.724492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0005da-cd1c-407b-86b5-ff63691bcddd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.724714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0005da-cd1c-407b-86b5-ff63691bcddd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.724984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0005da-cd1c-407b-86b5-ff63691bcddd None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.726191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0005da-cd1c-407b-86b5-ff63691bcddd None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.729040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0005da-cd1c-407b-86b5-ff63691bcddd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.738027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 182/363] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:02.739514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.739740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.740014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.763346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:02.764743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:02.766530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415e11f-62ae-41c9-b459-fedbe1378b67 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:02.819468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:02.821033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:02.821720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:02.822325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:02.823318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=67330f8be90f496e8bd37bc02087f8ae) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:02.823786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:02.825664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:02.833689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 182/364] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:02.834767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.852638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 183/365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:02.853706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:02.952434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:02.979071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed5476-770d-4d46-a5fb-a4e1019d5cea None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.007414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:03.019650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.022725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.022725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.022725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.022725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] RBAC: Adding query filter params (role.id=3232e1e490914d778785be7b1c3c0090, user.id=24c903c723f9400b93da6da570490f68, scope.system=all) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:03.022725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:03.024172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:03.043407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26041fb0-e64f-4f8b-8417-70ddcb50e904 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.047274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 183/366] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/role_assignments?user.id=24c903c723f9400b93da6da570490f68&scope.system=all&role.id=3232e1e490914d778785be7b1c3c0090 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:03.047274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.105773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.106545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.110817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.110817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.111721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:03.113240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:03.118823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 184/367] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:02 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:03.128684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.287872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79b86-dc5c-41b8-9034-317a737b11a4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.335043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4d6d8-5c6e-44a7-84ab-664c8e7984f4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.349888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.350899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.351737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.352112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.369571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:03.374830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:03.375727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:03.376523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 184/368] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:03.389095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.389862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:03.414843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.415711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.415940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.417524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.417524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=704ea304308b4c07a422828221278e65, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:03.417524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:03.418974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:03.425828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 185/369] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=704ea304308b4c07a422828221278e65 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:03.427716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.470006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:03.557389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0e7c0-8bc6-4e4d-87e8-b03746f91f63 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.579509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594738-82f9-4f42-b7f1-424ef98aad15 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.598829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.600491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.600966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.601998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.603012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:03.603497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:03.605141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:03.615504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 185/370] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:03.622044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.624674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.625341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.625622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.625894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.651068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:03.656529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:03.657525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:03.658324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 186/371] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:03.668534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.730956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:03.787360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c1b32-2e72-40e0-a312-3472da2686ac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.826001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.826619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.827036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.827317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.828000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:03.828302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:03.829707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:03.839124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 187/372] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:03.845600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:03.861118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026c72e-d500-448e-a799-e172a714e793 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.867674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:03.928582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:03.929785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:03.930187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:03.930359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:03.970493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ee249-052d-409a-98b0-6ca2af59ced9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:03.994161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:04.006886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:04.008560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:04.008560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:04.008560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:04.068911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.070940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.086719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.088412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.197578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 188/373] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:04.203347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:04.223147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:04.257698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 186/374] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:04.264267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:04.267896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:04.353077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d8483-075b-456b-8b12-c96d2c4f6391 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:04.399198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:04.400340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:04.400637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:04.400906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] PATH_INFO: `/v3/projects/bbd4e8f6f06741eca1091b51da45521e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:04.403977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=bbd4e8f6f06741eca1091b51da45521e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.406113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.412901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 189/375] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:04 2022] GET /identity/v3/projects/bbd4e8f6f06741eca1091b51da45521e => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:04.414376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:04.463809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d5312-a5a1-42a6-8adf-7fea7a7692b7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:04.515424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:04.516433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:04.516906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:04.517365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:04.518744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.520548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.524331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 187/376] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:04 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:04.531683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:04.547137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:04.570354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc1c7-2009-4d2f-935d-7baa9151a1a8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:04.620648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:04.621671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:04.622096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:04.622568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] PATH_INFO: `/v3/groups/82434caae043469899d94aa27ae55b31` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:04.632269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] RBAC: Authorizing `identity:get_group(group_id=82434caae043469899d94aa27ae55b31)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.634642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.636900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 190/377] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:04 2022] GET /identity/v3/groups/82434caae043469899d94aa27ae55b31 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:04.643972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:04.667331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:04.720668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b83c6-ced1-46e8-a7fd-ea4927434f0b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:04.758560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ab49-5c22-48e5-904d-4bcd856b4155 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:04.794288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:04.795208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:04.795602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:04.795976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:04.797610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:04.798381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:04.798496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.798921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:04.799351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:04.800231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] RBAC: Adding query filter params (group.id=82434caae043469899d94aa27ae55b31, role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=bbd4e8f6f06741eca1091b51da45521e) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:04.800343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.800772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:04.802344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b01d-672f-45d4-bddc-3268791b4bf1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:04.802587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 188/378] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:04 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:04.808974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:04.814828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 191/379] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:04 2022] GET /identity/v3/role_assignments?group.id=82434caae043469899d94aa27ae55b31&scope.project.id=bbd4e8f6f06741eca1091b51da45521e&role.id=afa0ce309d704597adab4050e9d32d4d => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:04.984280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223599b6-3abd-4e4f-ad98-1b51be784557 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:05.033841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea106-7c70-4adf-9526-52bc9c2e3112 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:05.034256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea106-7c70-4adf-9526-52bc9c2e3112 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:05.034441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea106-7c70-4adf-9526-52bc9c2e3112 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:05.035898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 192/380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:19:05.036231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:05.036854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:05.037143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:05.037422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:05.038167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:05.039035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:05.040789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98746ef9-1145-460e-86b5-1df3b3f268c7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:05.043659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d469-acb5-49c3-9692-b982c64366b1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:05.044238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d469-acb5-49c3-9692-b982c64366b1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:05.044709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d469-acb5-49c3-9692-b982c64366b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:05.051407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 189/381] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:04 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:05.059792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:05.067667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a350d469-acb5-49c3-9692-b982c64366b1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:05.069258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a350d469-acb5-49c3-9692-b982c64366b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:05.157911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 193/382] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:05.495415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408610d-7efb-455f-8dd8-8c9234a02391 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:05.495792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408610d-7efb-455f-8dd8-8c9234a02391 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:05.496004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408610d-7efb-455f-8dd8-8c9234a02391 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:05.497604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 190/383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:05.503404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:05.503687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:05.503962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:05.527140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:05.528372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:05.609780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 194/384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:05.668594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408610d-7efb-455f-8dd8-8c9234a02391 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:05.672568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:05.800179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408610d-7efb-455f-8dd8-8c9234a02391 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:05.836369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:05.837013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:05.837291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:05.837559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:05.849136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:05.855227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:05.856141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:05.856947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:05.861163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 191/385] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:05.862577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:05.933548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:05.969283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35549834-9901-46d5-8364-5eaa7b439c1a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.004577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.005187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.005466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.005738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.006410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:06.006721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.008310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.021825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 195/386] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:06.023735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.059689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.181309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95a22-711d-4204-b5d9-47fc3cdcb16c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.187082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:06.219086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:06.222185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.223143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.223571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.223981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.236949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:06.242487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:06.243677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:06.244652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:06.245361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8fc45-c0dd-49ad-8882-693c7c10eaee None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.247092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 196/387] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:06.254715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.294261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.295119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.295404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.295684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.296827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.298627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.300463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 192/388] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:06 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:06.307892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.430784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf36650-8fb3-47c8-8e7a-d70a76e1ca68 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.461218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5b0d-061e-4a29-8303-508f08b167b8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.470247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.470893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.471176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.471451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.472132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:06.472473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.473877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58ecf9-0e8d-42c5-ba81-fe4431e51269 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.488986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 197/389] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:06.490497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf90e-bceb-4771-a9f6-6cf293575e97 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.490813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf90e-bceb-4771-a9f6-6cf293575e97 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.491093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf90e-bceb-4771-a9f6-6cf293575e97 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.492885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 198/390] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:06.493805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaf90e-bceb-4771-a9f6-6cf293575e97 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.499921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:06.506724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df11c-a0dc-4cba-b980-d8412364da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.508938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df11c-a0dc-4cba-b980-d8412364da7a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.509401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df11c-a0dc-4cba-b980-d8412364da7a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.510640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df11c-a0dc-4cba-b980-d8412364da7a None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.512631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df11c-a0dc-4cba-b980-d8412364da7a None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.515859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df11c-a0dc-4cba-b980-d8412364da7a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.517777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 193/391] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:06 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:06.519720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.520263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.521010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.546886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:06.548101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:06.562162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:06.638046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaf90e-bceb-4771-a9f6-6cf293575e97 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.640417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 194/392] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:06.641445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.683161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.683768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.684050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.684324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.686037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.687509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.689949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:06 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:06.696293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.818426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4a2f2-4295-44c9-a2ec-fea1b6d96a83 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.825775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3765803-d010-4911-a0a5-df8530d4e180 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.839565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:06.859417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.860062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.860341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.860614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.861982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.863445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.865713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 200/394] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:06 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:06.871987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:06.886284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:06.900908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:06.901650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:06.901933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:06.902216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae/groups/37b0c0f406184977b8147e35f7ea2284/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:06.907980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] RBAC: Authorizing `identity:create_grant(project_id=67330f8be90f496e8bd37bc02087f8ae, group_id=37b0c0f406184977b8147e35f7ea2284, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:06.909455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:06.994927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59fe49-fc0c-4fca-a063-79c8080045ca None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:06.999886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 195/395] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 05:19:06 2022] PUT /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae/groups/37b0c0f406184977b8147e35f7ea2284/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:07.001006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:07.064257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:07.064960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.065253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.065533 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae/groups/37b0c0f406184977b8147e35f7ea2284/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.068034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] RBAC: Authorizing `identity:create_grant(project_id=67330f8be90f496e8bd37bc02087f8ae, group_id=37b0c0f406184977b8147e35f7ea2284, role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:07.069694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:07.146340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9456-5b86-47ca-ad76-5ce5a4b6589d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:07.150727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 201/396] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 05:19:06 2022] PUT /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae/groups/37b0c0f406184977b8147e35f7ea2284/roles/17bb4391783f400d995fb75b6e3f4684 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:07.189167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:07.189829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.190114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.190386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.203395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:07.208495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:07.209519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:07.211540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 196/397] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:07.217099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:07.275749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:07.347083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6a086-9347-4b84-bc6c-4486ab0e8315 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:07.397048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:07.398657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.399181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.399830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.400901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:07.401406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:07.403091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168970b-b4dd-441d-ac72-1a89a9abb149 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:07.417508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 202/398] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:07.422912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:07.464517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9554-abe0-45a7-afee-10f981775167 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.465159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9554-abe0-45a7-afee-10f981775167 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.465644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9554-abe0-45a7-afee-10f981775167 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.467533 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 203/399] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:19:07.484337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa304-6961-49bb-a9bf-351b0d5a2846 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.484981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa304-6961-49bb-a9bf-351b0d5a2846 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.485490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa304-6961-49bb-a9bf-351b0d5a2846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.511445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:07.524130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f90aa304-6961-49bb-a9bf-351b0d5a2846 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:07.525696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f90aa304-6961-49bb-a9bf-351b0d5a2846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:07.591526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686953b4-aefb-4a8e-bee7-5cbfef485ce0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:07.655369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 204/400] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:07.656283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:07.656627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba48b9-a736-4a61-a404-6900dc46594b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.657394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.657948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.658426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.659804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:07.661503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:07.663013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba48b9-a736-4a61-a404-6900dc46594b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.663480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba48b9-a736-4a61-a404-6900dc46594b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.664408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 197/401] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:07 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:07.668584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 205/402] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:07.669737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:07.672203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.672486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.672759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.702322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:07.711767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:07.747043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:07.801186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee921-7c03-498e-ac48-315859d6e225 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:07.821971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:07.842775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:07.843584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:07.843865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:07.844156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:07.845307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:07.846862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:07.849310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 198/403] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:07 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:07.858150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:07.858992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 206/404] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:07.964530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d58af-1e47-455f-a26f-03d6a0e2981b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.001100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.001812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.002098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.002377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/groups/37b0c0f406184977b8147e35f7ea2284/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.004361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1063a44f50243cfb7c8dd23be5b4d91, group_id=37b0c0f406184977b8147e35f7ea2284, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:08.005792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:08.063433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.111024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 199/405] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 05:19:07 2022] PUT /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/groups/37b0c0f406184977b8147e35f7ea2284/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:08.200299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.219997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085689e-d37d-4f7b-aaa3-7b45094a0a48 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.266098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.266796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.267075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.267340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.283009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:08.286887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:08.288064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:08.290204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:08.291284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 207/406] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:08.294823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.327353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:08.353668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6934-8411-41e3-b53b-074b9d419c91 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.396130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.397019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.397464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.398425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.408023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9178-7dc6-45e8-aa63-7eaa51c7bb7c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.412554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:08.421323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:08.423138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:08.424696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:08.428327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 200/407] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:08.436274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.468615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.469244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.469523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.469790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.470491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:08.470883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:08.472350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:08.493041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 208/408] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:08.498575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.615913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa99d-3962-4b09-8bed-47e8d3eb3245 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.627119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:08.654774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.655325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.655879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.656160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.656840 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:08.657148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:08.658542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:08.670049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 201/409] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:08.676713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.734168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:08.758389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3d6ad-ac2d-47b9-997f-565dc6a717d9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.815318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.816235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.816515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.818154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.820746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:08.822211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:08.823859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 209/410] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:08.829413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:08.879186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140813f-6038-40c1-b52e-88527ec5889e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:08.947523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:08.948086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:08.948365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:08.948639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] PATH_INFO: `/v3/groups/82434caae043469899d94aa27ae55b31` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:08.951054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] RBAC: Authorizing `identity:get_group(group_id=82434caae043469899d94aa27ae55b31)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:08.953266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:08.954912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 202/411] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/groups/82434caae043469899d94aa27ae55b31 => generated 229 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:08.963410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:09.034815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ff5a4-d7a3-49d4-b900-3fdc3f673b73 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:09.037203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:09.101825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:09.102540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.102767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.107346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.110250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:09.111756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:09.114468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 210/412] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:09.120636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:09.160964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef506a-533c-43fd-a5d0-c88b48d561b0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:09.175057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:09.231776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:09.234817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.234817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.234817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] PATH_INFO: `/v3/projects/bbd4e8f6f06741eca1091b51da45521e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.234817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] RBAC: Authorizing `identity:get_project(project_id=bbd4e8f6f06741eca1091b51da45521e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:09.236555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:09.245359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 203/413] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:08 2022] GET /identity/v3/projects/bbd4e8f6f06741eca1091b51da45521e => generated 344 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:09.251223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:09.321271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae43dde-3691-4c18-be40-636872314269 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:09.394624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e53f-3f3b-48f2-aebe-4b84c1789c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:09.395334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e53f-3f3b-48f2-aebe-4b84c1789c18 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.395621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e53f-3f3b-48f2-aebe-4b84c1789c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.401282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e53f-3f3b-48f2-aebe-4b84c1789c18 None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/groups/37b0c0f406184977b8147e35f7ea2284/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.404685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e53f-3f3b-48f2-aebe-4b84c1789c18 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1063a44f50243cfb7c8dd23be5b4d91, group_id=37b0c0f406184977b8147e35f7ea2284, role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:09.407715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e53f-3f3b-48f2-aebe-4b84c1789c18 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:09.438747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7567b-8634-4080-b7b9-b4cb1c248fae None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:09.442450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:09.477081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e93f03-ede4-448f-9d2d-4b7da5a07b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:09.477775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93f03-ede4-448f-9d2d-4b7da5a07b11 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.478056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93f03-ede4-448f-9d2d-4b7da5a07b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.478339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93f03-ede4-448f-9d2d-4b7da5a07b11 None admin] PATH_INFO: `/v3/projects/bbd4e8f6f06741eca1091b51da45521e/groups/82434caae043469899d94aa27ae55b31/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.480556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e93f03-ede4-448f-9d2d-4b7da5a07b11 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbd4e8f6f06741eca1091b51da45521e, group_id=82434caae043469899d94aa27ae55b31, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:09.482099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e93f03-ede4-448f-9d2d-4b7da5a07b11 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:09.490664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 211/414] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 05:19:09 2022] PUT /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91/groups/37b0c0f406184977b8147e35f7ea2284/roles/17bb4391783f400d995fb75b6e3f4684 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:19:09.493802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5576e63-32af-4152-8864-eebc739bd3ca None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.494411 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5576e63-32af-4152-8864-eebc739bd3ca None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.501479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5576e63-32af-4152-8864-eebc739bd3ca None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.501479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 212/415] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:09.503735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.504359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.504842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.535467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:09.537184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:09.560898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 204/416] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 05:19:09 2022] PUT /identity/v3/projects/bbd4e8f6f06741eca1091b51da45521e/groups/82434caae043469899d94aa27ae55b31/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:09.594738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efaebd-1911-4fd2-a484-0efa20e91379 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.594993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efaebd-1911-4fd2-a484-0efa20e91379 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.595250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efaebd-1911-4fd2-a484-0efa20e91379 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.596775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 205/417] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:19:09.606954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:09.607179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:09.607427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:09.642098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 213/418] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:09.648972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:09.650211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:09.764593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 206/419] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:09.952052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:09.973200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.055643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:10.092473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40946da4-0692-477f-953b-a4119b87d7a7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:10.165470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:10.166131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.166449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.166649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.187402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:10.192096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:10.192981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:10.193796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:10.194464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 214/420] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:10.203804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:10.223645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.232170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13014d-4475-43ea-9fed-8d045596b55d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:10.271732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:10.273358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.273895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.274366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.285701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:10.292623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:10.293764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:10.294666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:10.302634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 207/421] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:10.303069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:10.359740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.386163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852cf6-c095-4617-a307-fb0e1d51782e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:10.424429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:10.425344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.425771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.426203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.427067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:10.427514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:10.429604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:10.439054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 215/422] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:10.446484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:10.500733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf881bd-c9d0-423e-a6e0-b661c901e5e2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:10.540671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:10.541383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.541796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.542142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.543020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:10.543394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:10.544971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feaae3-d47b-44c3-ab95-245b5c926e19 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:10.560374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 208/423] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:10.560374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819a67-6c60-4a04-9395-160f863847cd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.560374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819a67-6c60-4a04-9395-160f863847cd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.560374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819a67-6c60-4a04-9395-160f863847cd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.560374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 209/424] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:10.562048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b819a67-6c60-4a04-9395-160f863847cd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:10.578176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4f761-c3ea-46a1-bfb6-7abe98abf583 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:10.588893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.627083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab73fab-60cd-42c1-9b98-ccf91d3e80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:10.628044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab73fab-60cd-42c1-9b98-ccf91d3e80d3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.628537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab73fab-60cd-42c1-9b98-ccf91d3e80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.629008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab73fab-60cd-42c1-9b98-ccf91d3e80d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.641100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.707364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b819a67-6c60-4a04-9395-160f863847cd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:10.727960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab73fab-60cd-42c1-9b98-ccf91d3e80d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:10.730205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab73fab-60cd-42c1-9b98-ccf91d3e80d3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:10.754199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:10.755009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.755285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.755563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.851236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:10.852788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:10.874982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 216/425] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:10.876271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378527-1721-4afb-819b-6010994ee5ea None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:10.876554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378527-1721-4afb-819b-6010994ee5ea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:10.876923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378527-1721-4afb-819b-6010994ee5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:10.885204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.895812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-04378527-1721-4afb-819b-6010994ee5ea None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:10.897012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04378527-1721-4afb-819b-6010994ee5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:10.930156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:10.978037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 217/426] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:10.979234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04378527-1721-4afb-819b-6010994ee5ea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:10.983076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 210/427] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:10.994894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.090236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04378527-1721-4afb-819b-6010994ee5ea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.127782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.128426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.128702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.128972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.130214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.133536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.135795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 218/428] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.142019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.216160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:11.266142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81219317-a4d1-4588-97c7-f266f0f7a892 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.285412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:11.307076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.307719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.307996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.308268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] PATH_INFO: `/v3/projects/67330f8be90f496e8bd37bc02087f8ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.309466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] RBAC: Authorizing `identity:get_project(project_id=67330f8be90f496e8bd37bc02087f8ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.310941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.317167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 211/429] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:10 2022] GET /identity/v3/projects/67330f8be90f496e8bd37bc02087f8ae => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.318014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.324032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca13ac-2df0-4a8f-a1c7-dd61fe5b6aeb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.360967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.361627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.361904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.362174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.363293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.364888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.367413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 219/430] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.368387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.426105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a7f0-cbf0-413b-904a-dc3401b82b07 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.463586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.464332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.464679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.465073 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.474608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb590d-c7b2-45a3-bd5d-3d0f5caf5b35 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.476776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:11.477470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:11.483359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:11.489952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 212/431] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:11.490769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.512822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.513500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.513781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.514050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.515289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.516862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.518990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 220/432] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.519825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.546085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:11.621482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13217-df38-4d25-b414-8ee011e6fd60 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.638186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439550-9fb5-4cd8-806a-c8fc619e46c2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.659019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.660053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.660596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.661077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.661993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=67330f8be90f496e8bd37bc02087f8ae) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:11.662505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.664905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.671959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 213/433] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.673084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.676530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.678082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.678386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.678665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.679493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:11.679950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.681517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.698719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 221/434] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.701899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:11.748130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:11.814592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0843-8ac2-4531-824b-f0cc1a17445f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.826076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:11.833021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656ad7-922d-4a64-8ce0-673e6d1672ba None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:11.856219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.857269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.857780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.858257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.859311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=704ea304308b4c07a422828221278e65, scope.project.id=67330f8be90f496e8bd37bc02087f8ae) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:11.859865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.861714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ebaf-935b-4071-9cc5-5dea8388b43b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:11.869340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 214/435] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=67330f8be90f496e8bd37bc02087f8ae&role.id=704ea304308b4c07a422828221278e65 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:11.881545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:11.882610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f6883-9fe6-41bf-a9db-545acb2c0078 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.882765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.883107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.883405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.883696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f6883-9fe6-41bf-a9db-545acb2c0078 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.884306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f6883-9fe6-41bf-a9db-545acb2c0078 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.885919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 215/436] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:11.887562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6633338-ad92-4326-bbbe-b042f85202ad None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.888021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6633338-ad92-4326-bbbe-b042f85202ad None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.888462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6633338-ad92-4326-bbbe-b042f85202ad None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.890146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 216/437] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:11.900205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818545-ab42-41b7-ba5c-d8840406686a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:11.900786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818545-ab42-41b7-ba5c-d8840406686a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:11.901238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818545-ab42-41b7-ba5c-d8840406686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:11.920827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-47818545-ab42-41b7-ba5c-d8840406686a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:11.922373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-47818545-ab42-41b7-ba5c-d8840406686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:11.975276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:11.977682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:12.019229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 217/438] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:12.020811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.022301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.023535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.024036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.045143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:12.046680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:12.103925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 222/439] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:12.110565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.131725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 218/440] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:12.217875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b2ce-5ffb-45b7-a630-872b40bccedc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.255082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.255642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.255920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.256190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.258149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:12.259939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:12.262143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 223/441] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:12.267706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.304834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.306866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.309938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.388198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21397cd-0981-4dab-abd7-c7fbe9d2b208 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.430208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.431157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.431440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.431712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.433292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:12.435067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:12.435755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956d9f-1299-48a1-b6fd-933ec6a69bed None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.437752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 219/442] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:12.438815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.475935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.476578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.476861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.477132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.490045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:12.496481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:12.497587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 224/443] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:12.499098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.565019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.566606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.568144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cac6d-1120-47b2-887c-7e25e5997aae None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.603144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.603781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.604054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.604319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.606074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e395cd4-b4b1-443b-89dc-36d00d307053 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.616676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:12.623013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:12.624148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:12.625124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:12.626022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 220/444] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:12.626022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.645699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.646553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.646888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.647158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.648665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=704ea304308b4c07a422828221278e65, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:12.648982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:12.650425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:12.656659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 225/445] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=704ea304308b4c07a422828221278e65 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:12.657375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.749720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb9b0-6e2c-4c18-9049-1834cc8243e9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.776727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bdc3-460f-4f08-80ea-d9d3136fec2b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.789052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.789699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.789958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.790232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.790932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:12.791241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:12.792616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:12.801067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 221/446] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:12.806168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.807702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.816992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.818314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.818822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.819102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:12.827301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:12.827301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:12.827301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:12.832438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 226/447] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:12.839149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:12.839325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:12.936624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aa68c-7727-4936-8e92-0f7211f8a5b7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.961804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7eb7-6432-49da-aeff-327c110908e0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:12.976373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:12.977344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:12.977625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:12.977897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.005724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.006570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.007563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.007995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.059194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.060637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.067291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:13.079482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.083535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.083668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:13.157811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 222/448] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:13.164326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:13.180807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 227/449] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:13.186563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:13.264041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e912f-1645-4731-af90-21c9c953f842 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:13.275004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:13.286969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9aed-9b8b-4bfa-8543-97c59a8ba410 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:13.287311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:13.298304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.298962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.299245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.299516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] PATH_INFO: `/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.300675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] RBAC: Authorizing `identity:get_project(project_id=c1063a44f50243cfb7c8dd23be5b4d91)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.302108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.304012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 223/450] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:13 2022] GET /identity/v3/projects/c1063a44f50243cfb7c8dd23be5b4d91 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:13.309494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:13.321137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.321712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.322153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.322877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] PATH_INFO: `/v3/projects/bbd4e8f6f06741eca1091b51da45521e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.324000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=bbd4e8f6f06741eca1091b51da45521e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.325443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.327257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 228/451] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:19:13 2022] GET /identity/v3/projects/bbd4e8f6f06741eca1091b51da45521e => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:13.332569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:13.412996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5d2cc-59a0-48af-a17e-db5887702ada None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:13.435983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58890-bfeb-44d1-80ac-9f78ce62e4f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:13.447143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.447777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.448060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.448335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] PATH_INFO: `/v3/groups/37b0c0f406184977b8147e35f7ea2284` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.449460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] RBAC: Authorizing `identity:get_group(group_id=37b0c0f406184977b8147e35f7ea2284)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.450927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.452498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 224/452] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:13 2022] GET /identity/v3/groups/37b0c0f406184977b8147e35f7ea2284 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:13.458151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:13.474432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.475095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.475368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.475666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] PATH_INFO: `/v3/groups/82434caae043469899d94aa27ae55b31` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.476779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] RBAC: Authorizing `identity:get_group(group_id=82434caae043469899d94aa27ae55b31)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.478225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.479804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 229/453] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 05:19:13 2022] GET /identity/v3/groups/82434caae043469899d94aa27ae55b31 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:13.485495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:13.510414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:13.517735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:13.559471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227a02-e7f8-4162-9485-ed20e491745d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:13.587181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e426b-832a-48c8-9175-65fdc61586fc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:13.597543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.598278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.598932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.598932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.599583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] RBAC: Adding query filter params (group.id=37b0c0f406184977b8147e35f7ea2284, role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:13.599892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.601549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f13dd-45b9-4ccd-be18-a20f8dcaa1ca None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.607784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 225/454] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:13 2022] GET /identity/v3/role_assignments?group.id=37b0c0f406184977b8147e35f7ea2284&scope.project.id=c1063a44f50243cfb7c8dd23be5b4d91&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:13.623252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:13.623876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:13.624156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:13.624426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:13.625181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] RBAC: Adding query filter params (group.id=82434caae043469899d94aa27ae55b31, role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=bbd4e8f6f06741eca1091b51da45521e) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:13.625508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:13.627126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4a6f-dfb2-4874-b645-0997e359a677 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:13.635046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 230/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 05:19:13 2022] GET /identity/v3/role_assignments?group.id=82434caae043469899d94aa27ae55b31&scope.project.id=bbd4e8f6f06741eca1091b51da45521e&role.id=afa0ce309d704597adab4050e9d32d4d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:16.100891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47401d72-2b2b-423a-906e-f77098d19ae5 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:16.102588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47401d72-2b2b-423a-906e-f77098d19ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:16.103111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47401d72-2b2b-423a-906e-f77098d19ae5 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:16.104906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 226/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:16.110446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dc864-564e-4160-8c91-1f8c4fc6041b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:16.110929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dc864-564e-4160-8c91-1f8c4fc6041b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:16.111018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dc864-564e-4160-8c91-1f8c4fc6041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:16.136679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ef0dc864-564e-4160-8c91-1f8c4fc6041b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:16.138146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ef0dc864-564e-4160-8c91-1f8c4fc6041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:16.223895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 231/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:16.269844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e981c-22e5-4277-84e1-3e2019673920 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:16.270571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e981c-22e5-4277-84e1-3e2019673920 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:16.271083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e981c-22e5-4277-84e1-3e2019673920 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:16.274326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 227/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:16.280779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:16.280779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:16.280779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:16.309183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:16.310388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:16.333793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:16.411458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 232/459] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:19:16.558729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e981c-22e5-4277-84e1-3e2019673920 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:16.709163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:16.730724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e981c-22e5-4277-84e1-3e2019673920 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:16.779758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:16.812763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:16.815092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:16.817213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:16.817976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:16.841881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:16.844315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:16.863242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:16.864328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:16.865164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:16.865164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:16.865164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:16.865164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 228/460] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:16.873376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:16.898279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35e83a-8905-4172-a07e-8f3fb6e4d10d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:16.974268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:16.974932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:16.975211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:16.975549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:16.986770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:16.988457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:16.997465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-bc9210db-1b9d-4771-90dc-c477500efbd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:17.005096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:17.015073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 233/461] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ad05e-0ef7-403f-9f82-bf8cc597cd30 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ad05e-0ef7-403f-9f82-bf8cc597cd30 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ad05e-0ef7-403f-9f82-bf8cc597cd30 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 234/462] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:17.015956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ad05e-0ef7-403f-9f82-bf8cc597cd30 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.042287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e062d77-9abb-496c-8270-ee5982c9f028 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:17.079259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:17.079879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.080157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.080482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.081134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:17.081436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:17.082822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c2ef-7884-4a04-839f-77957af0e617 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:17.097210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 229/463] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:17.100065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a95e-46a8-41f7-bf34-339b975b2675 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.100417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a95e-46a8-41f7-bf34-339b975b2675 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.100699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a95e-46a8-41f7-bf34-339b975b2675 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.106064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 230/464] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:17.106064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae5e4-c93b-4ce5-83cf-1368de2dd621 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.106064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae5e4-c93b-4ce5-83cf-1368de2dd621 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.106064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae5e4-c93b-4ce5-83cf-1368de2dd621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.123218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e8fae5e4-c93b-4ce5-83cf-1368de2dd621 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:17.124431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e8fae5e4-c93b-4ce5-83cf-1368de2dd621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:17.136611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ad05e-0ef7-403f-9f82-bf8cc597cd30 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:17.155746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:17.174591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:17.175234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.175513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.175786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.176438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:17.176804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:17.178259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:17.202061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 235/465] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:17.202061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.202330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 231/466] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:17.202330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c83c-8afc-473e-9287-482b93179bee None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.202330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c83c-8afc-473e-9287-482b93179bee None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.202330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c83c-8afc-473e-9287-482b93179bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.227181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9410c83c-8afc-473e-9287-482b93179bee None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:17.229027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9410c83c-8afc-473e-9287-482b93179bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:17.284034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:17.335407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569cad-04e3-469e-8c5c-59b4fb740442 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:17.339085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 232/467] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:17.340166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c83c-8afc-473e-9287-482b93179bee None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.403012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:17.404015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.404493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.404971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.405827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:17.407505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:17.483202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:17.489699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c83c-8afc-473e-9287-482b93179bee None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:17.527133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 236/468] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:19:17 2022] POST /identity/v3/users => generated 246 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:17.528149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.542446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:17.545219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.545770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.546245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.547930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:17.550059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:17.647396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 233/469] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:19:17 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:17.650951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.742785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49afc78-4c5a-4c70-ae45-03df4be043c0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:17.769911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:17.802966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:17.803741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.804078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.804358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.820821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:17.823084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:17.833988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b78263-97df-4e13-b030-67d4b53d4fb5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:17.845284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:17.846221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:17.848161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:17.848161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:17.848161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:17.848161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 237/470] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:17.856565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.886523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:17.887609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.887941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.888216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.905503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:17.907212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9a85865a-f072-487f-b806-78f7670c34e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:17.923424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:17.924403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:17.925266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:17.925266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:17.925266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:17.925266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 234/471] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:17.925938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387986d-9330-49f7-9b0e-ebdb4a357d8e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:17.926226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387986d-9330-49f7-9b0e-ebdb4a357d8e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:17.926498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387986d-9330-49f7-9b0e-ebdb4a357d8e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:17.927809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 235/472] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:17.934083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387986d-9330-49f7-9b0e-ebdb4a357d8e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:17.936967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:18.008811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348fd5-cf29-49f4-9ab7-ae2b977b3415 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:18.058865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:18.060055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:18.060538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:18.060993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:18.062096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:18.063040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:18.065226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf473df-5021-4227-9710-27a49e5cae91 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:18.071743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387986d-9330-49f7-9b0e-ebdb4a357d8e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:18.080128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 238/473] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:18.085944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:18.085944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:18.085944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:18.102709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:18.104179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:18.123659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:18.125265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:18.125693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:18.126110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:18.126992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:18.127437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:18.129848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:18.131332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:18.149793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 236/474] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:18.150910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:18.188069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 239/475] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:18.189221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:18.237553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:18.294993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b121d4-4914-4125-8c6c-7f245378c7ea None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:18.332147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9608bd-21b3-4ad1-8cae-0147ed98c894 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:18.344112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:18.344814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:18.345235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:18.345604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:18.346409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:18.347990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:18.380970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:18.381708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:18.381991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:18.382261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:18.383003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:18.384464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:18.459656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 237/476] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:19:18 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:18.489238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:19:18 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:18.548740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:18.707959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7346-dd8d-4e85-8c32-8446ebf940a7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:18.728831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:18.746241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:18.746889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:18.747170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:18.747440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:18.748112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:18.749571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:18.812472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.sql.core [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:19:18.812472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 05:19:18.812472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [parameters: {'id': '82f706e336dc44b6a95f918853d853ac', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 05:19:18.812472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81641) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result.read() Aug 24 05:19:18.829589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:19:18.830527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application yield resource Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise self.value Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application session.commit() Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:19:18.831496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:19:18.832378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:19:18.833261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result.read() Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:19:18.834109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [parameters: {'id': '82f706e336dc44b6a95f918853d853ac', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:18.835488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 05:19:18.836278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:18.837175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 05:19:18 2022] POST /identity/v3/roles => generated 144 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:18.838950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:18.859784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:18.962527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f2221-7113-4376-8a66-29ac5023257a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:19.014539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a0337-f5c4-43d2-9b5f-79ee228a5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:19.015611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a0337-f5c4-43d2-9b5f-79ee228a5a97 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:19.016100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a0337-f5c4-43d2-9b5f-79ee228a5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:19.016561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a0337-f5c4-43d2-9b5f-79ee228a5a97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:19.027971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a0337-f5c4-43d2-9b5f-79ee228a5a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7b9a0337-f5c4-43d2-9b5f-79ee228a5a97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:19.033436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:19.034304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:19:19.035134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:19.038327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:19.043810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:19.195872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8cafe-cbf2-4c55-803b-76b8058658c5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:19.247746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:19.248374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:19.248658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:19.248929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:19.249718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:19.250029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:19.251424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685621-4909-49cf-84d7-534815a38b3f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:19.265476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:19.907493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbf7ef-fe0c-4efc-a256-e313238db1ac None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:19.908003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbf7ef-fe0c-4efc-a256-e313238db1ac None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:19.908003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbf7ef-fe0c-4efc-a256-e313238db1ac None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:19.909553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 242/481] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:19.915442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7839-f5ee-464e-9095-8f72d17d8f8a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:19.915729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7839-f5ee-464e-9095-8f72d17d8f8a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:19.916007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7839-f5ee-464e-9095-8f72d17d8f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:19.944249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c79c7839-f5ee-464e-9095-8f72d17d8f8a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:19.945458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c79c7839-f5ee-464e-9095-8f72d17d8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:20.016079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:20.051646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:19:20.204238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bcdb7-c373-481c-9898-779c787e5a08 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:20.204421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bcdb7-c373-481c-9898-779c787e5a08 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:20.204693 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bcdb7-c373-481c-9898-779c787e5a08 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:20.206246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 243/483] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:20.211830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:20.212296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:20.212384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:20.231025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:20.232213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:20.322723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 241/484] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:20.374855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bcdb7-c373-481c-9898-779c787e5a08 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:20.474530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:20.508880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bcdb7-c373-481c-9898-779c787e5a08 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:20.548597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:20.549226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:20.549503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:20.549773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:20.560860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:20.565593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:20.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:20.567279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 244/485] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:20.576119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:20.671267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:20.723985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcfca2-dde1-4712-a30a-f5084705ebc0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:20.730885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:20.811525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:20.812157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:20.812437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:20.812714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:20.813402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:20.813705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:20.815125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:20.827654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1515-3f6f-4285-96bc-c5c10b4a1145 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:20.832298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 242/486] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:20.841971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:20.874740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:20.875799 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:20.876278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:20.876882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:20.880622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:20.898444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:20.903732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:20.904610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:20.905410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:20.908064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 245/487] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:20.915209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.064116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2056bfa-5322-4954-96b1-99628b58bbd5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.087196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78214918-cdea-4336-9b3e-486aaf5103d5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.123836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.124956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.125500 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.126099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.127242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.127908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.128252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.128588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.129515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:21.129884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:21.131797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1204c5-547e-4e43-8370-d7da9b20238e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:21.140892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:21.141932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 246/488] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:21.146723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95857f6-1bb3-42f2-9157-f19ab3644a5f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.146723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95857f6-1bb3-42f2-9157-f19ab3644a5f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.146723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95857f6-1bb3-42f2-9157-f19ab3644a5f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.147849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:21.150492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 247/489] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:21.152141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.152429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.152701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:21.168133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:21.169106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:21.169941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:21.169941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:21.169941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:21.172055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 243/490] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:21.177413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.178726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:21.180019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:21.208355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:21.250588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:21.272974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 248/491] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:21.274379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.345206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bcd7d-6a9a-4eb1-94ac-bc7bbc7bfc53 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.392243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.393271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.393745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.394777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.408482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf5641-3d32-4985-b379-11665fcf8a71 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.409451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:21.412328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-53aa3aa6-26d5-4d5a-9787-3475cd7d1d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:21.433135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:21.434105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:21.434972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:21.434972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:21.434972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:21.440832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 244/492] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:21.440832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3f8f-3858-4967-a39e-ee01f6be8d2f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.440832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3f8f-3858-4967-a39e-ee01f6be8d2f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.440832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3f8f-3858-4967-a39e-ee01f6be8d2f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.442826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 245/493] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:21.444764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e3f8f-3858-4967-a39e-ee01f6be8d2f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.458756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.459401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.460474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.461266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.461944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:21.462251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:21.463706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e31bd0-e5d1-4d32-a88c-c65fe681a6e8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:21.480914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 249/494] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:21.480914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.480914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.480914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.502666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:21.503947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:21.549855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:21.571133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:21.593774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e3f8f-3858-4967-a39e-ee01f6be8d2f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.610724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 250/495] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:21.610724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.642542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.643248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.643534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.643811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.644491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:21.644799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:21.646278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:21.663645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 246/496] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:21.664534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.752865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6deb6-3030-4f82-a991-b1b7d8517396 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.788629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c4f51-ea0b-465c-a3ec-be912f734bfe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.797509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.798249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.798593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.799131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.809452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:21.811130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:21.825647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:21.826622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:21.827540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 251/497] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:21.830714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.836130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:21.844307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.845773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.846246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.846675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:21.863029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:21.868948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:21.869908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:21.870741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 247/498] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:21.871414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:21.880264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:21.956058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127314-3669-4f35-98cc-ccf302251f94 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.981611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca5a4-55af-43d3-ad0d-25325ece97d4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:21.994315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:21.994981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:21.995259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:21.995532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.003783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.005261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.017544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:22.017965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:22.019072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:19:22.024660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:22.025196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.025196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.025196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.025383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 252/499] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:22.025449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:22.025449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.025573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.025638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.061324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 248/500] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:19:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:22.062196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.112739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.133597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.133597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d299b91-62a7-4434-af66-4a767080c7d7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.165841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.166446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.166607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ae9a-db66-4d4e-ac0f-6189ba960fed None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.166750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.167016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.167747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:22.168060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.169457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc626-f9c4-4ffb-95e1-d10d6b7ab810 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.177923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 253/501] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:22.179691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5a216-1b40-4a06-9e1f-13d072062340 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.179974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5a216-1b40-4a06-9e1f-13d072062340 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.180248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5a216-1b40-4a06-9e1f-13d072062340 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.181472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 254/502] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:22.182164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5a216-1b40-4a06-9e1f-13d072062340 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.207606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.208244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.208525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.208804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.220016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:22.225217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:22.226272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 249/503] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:22.227382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.294126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5a216-1b40-4a06-9e1f-13d072062340 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.328049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.328652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.328927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.329197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.329930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:22.330232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.330384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742031-7da6-4bd3-8ecc-4beeb7c026c2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.331712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.340329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.365083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.366265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.366265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.366265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.369169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 255/504] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:22.370011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.389045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.440488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.441962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.477363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7741-7eb5-407d-9244-8f8e6e3db91b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.512656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.513327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.513608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.513884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.524188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.525665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b6a9d9db-a5dd-4849-b069-650240f5d7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:22.540751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:22.541785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:22.542642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:22.542642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:22.542642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:22.542642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 256/505] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:22.542883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 250/506] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:22.547852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.547852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.548118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.548199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.556532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.562606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:22.563835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:22.627916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.634369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 257/507] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:22.635038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.667146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988799-a107-4466-a6fa-06489b062f4d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.704041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.704646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.704920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.705191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.705856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:22.706153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.707563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.720536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 251/508] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:22.720536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.753737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7de7a-de04-4ca1-9a9b-a67ac037f286 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.792719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.793335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.793617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.793886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.806590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.839541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334447-d0da-4098-a06c-7be80ca9b1b0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:22.866467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:22.872051 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.873600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.875341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:22.875963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:22.876302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:22.876517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:22.877164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:22.877466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:22.878868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:22.891752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 252/509] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:22.892586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.984751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 258/510] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:22.986181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:22.999239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ed4b-2ba3-4329-a4db-f8b245ca4fbe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.044393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.051013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.051695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.052057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.062497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.062993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.064445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:23.081899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:23.083184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:23.084059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:23.084059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.084059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:23.084059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 253/511] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:23.084316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.093207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.097090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2cba3-23eb-48cd-98ce-5b3a63054658 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.154889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.155917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.156418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.156905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.172727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.174182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:23.189553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:23.190634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:23.191527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:23.191527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.191527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:23.191689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84777357-2d1d-4832-a831-68b5eb01b5a9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.191761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 259/512] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:23.191761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.226230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.226909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.227187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.227465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.235229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.236625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:23.249707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:23.250896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 254/513] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:23.251985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.296481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.297942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dbd10-c201-4cd5-9504-a712c94cb3d6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.332978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.333611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.333888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.334157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.345024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.346509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.355790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36320d39-f192-45e5-a8b9-576f17af30cf None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:23.361266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:23.362237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:23.363341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:23.363341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.363341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:23.363341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 260/514] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:23.363551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.367043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.391722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.392359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.392636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.392905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.404912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.406385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:23.423783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:23.424780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:23.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:23.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:23.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:23.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 255/515] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:23.425831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.483766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55696334-1755-42f1-8dea-c960a303f312 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.518225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.518777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.519057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.519327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.519983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:23.520280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.521661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.525512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.532485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d3f6-fc67-4534-8415-386fbecb6a0f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.533430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 261/516] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:23.538638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.568780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.569536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.569822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.570093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.570767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:23.571072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.572465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.584304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 256/517] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:23.585355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.603479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.645193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc747ff-dd39-4ad0-8ed9-c92909b1daac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.682342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.682985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.683257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.683530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.684262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:23.684565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.686005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.692310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01454e-5c2d-4efa-a75c-f6a7779e2fd5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.703601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 262/518] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:23.704431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.727833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.728444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.728728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.729004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.729656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:23.729961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.731378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.744213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 257/519] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:23.745062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.761217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.812174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3a86-61b6-477e-bb19-1f39f8c0e90e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.837401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.847625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1232b9f-6dfe-4bb0-9c8e-66a195b80ed1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.853244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.853244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.853244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.853244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.853613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:23.853696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.855085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.866488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 263/520] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:23.867350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.885797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:23.886429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:23.887016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:23.887277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:23.894418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:23.895894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:23.908562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:23.909488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:23.910326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 258/521] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:23.910968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:23.971597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470c0d0-9b7d-4ee1-aa66-54f26c7c1f00 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:23.988418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.007762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.008395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.008675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.008948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.012921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78f3fc-031d-4826-a40b-8ab879f9aad4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.016959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.018423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:24.030840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:24.031822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 264/522] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:24.032736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.048105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.048710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.048986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.049258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.078787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.117540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.119028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.160951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367bf0-0e25-4f17-a33d-09aba8645ff2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.193305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.215168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.215782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.216087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.216346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.217000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.218458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.218764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 259/523] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:24.223281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.314809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 265/524] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:19:24 2022] POST /identity/v3/users => generated 247 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:24.315704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.325006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969b93b-1531-41af-932a-19543817d2a1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.371961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.372609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.372898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.373176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.380918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.382953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:24.395568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:24.397627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:24.398461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 260/525] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:24.399631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.435621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.453015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.460344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057938e4-83c8-4f2a-96ab-8032845e9c7b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.500004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.500239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.500617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.500793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.501477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:24.501786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.503355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.518290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460418-fc4c-48f3-96da-e329faeb1f4a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.526112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 266/526] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:24.527301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.557325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.557946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.558225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.558708 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.559369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:24.559581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.561011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.587692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 261/527] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:24.587692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.646285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952296a-49ed-4f26-9518-79c7243f5b63 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.686339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.687021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.687327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.687604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.689268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.700498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.700853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67202a-0069-4578-8c46-1b7a49e8b7ba None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.701998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:24.719544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:24.720545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:24.721406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:24.721406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:24.721406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:24.721406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 267/528] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:24.722443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.734333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.745090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.745779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.750426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.750426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.750426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:24.750426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.750426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.773660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 262/529] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:24.773660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.839862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da2eb-c25f-4637-aa00-51717c0dbbf3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.877016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.877795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.878079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.878402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.879286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=5704b06613b94c92896a39fc2b24c280) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:24.879597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:24.881332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:24.885414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f5405-9506-4830-a446-5ee6c8fe2216 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:24.898884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 268/530] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/role_assignments?user.id=5704b06613b94c92896a39fc2b24c280&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:24.898884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:24.939455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:24.940230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:24.940585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:24.940929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:24.967796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:24.986567 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.027225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04622f60-8fd3-43a3-9026-019de392ef11 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.038566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.040597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.068507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.069172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.069457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.069734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.070396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:25.070720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.072915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.091138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 269/531] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:25.092340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.167533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 263/532] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:25.168772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.228028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.229241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9862-4da3-4b51-b454-8ab6098c6646 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.270279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.275878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.276527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.277152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.277152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.278081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=68071674452b42839ffac496a902737d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:25.278504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.280096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.284044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b0c28-9d57-4f4c-80d9-3879ec6abd2e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.290938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 270/533] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/role_assignments?user.id=68071674452b42839ffac496a902737d&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:25.290938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.344963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.346199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.347627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.348872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.363994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.368941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:25.390624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:25.391565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:25.392395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:25.394669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 264/534] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:25.401493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.501361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5049-c9f6-40ed-beca-a628c58dcdf5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.546730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.546730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.546730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.546730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.558101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.559626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:25.577502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:25.578457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:25.579335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:25.579335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:25.579335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:25.579335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 271/535] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:25.585110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.608759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135cf3-5e39-4c6d-a957-2bc01cc82589 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.639655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.683082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.708590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.709776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.710062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.710334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.711083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:25.711391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.712844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.733294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 265/536] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:25.739678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.765912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343048a-edfb-4872-acb8-6d5bd74154f0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.831644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.832260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.832537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.832811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.833469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:25.833779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.835256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.857605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 272/537] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:25.863553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:25.914012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb51622-90ef-4099-9ef4-a7af67b44ced None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:25.959970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:25.960834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:25.961257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:25.961670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:25.962560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=dddbf44c00e7411db8084d75fee531e1) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:25.968445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:25.970107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:25.979441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 266/538] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/role_assignments?user.id=dddbf44c00e7411db8084d75fee531e1&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:26.065645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3778ce8-927a-4244-a75d-dc3803d916bc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:26.086719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:26.120228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:26.121184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:26.121602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:26.122011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:26.134852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:26.136573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:26.155454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:26.156513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:26.157556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:26.164523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 273/539] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:26.170383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:26.214300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:26.296859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b121-4456-4869-99d2-3f445a8747ca None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:26.345768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:26.346625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:26.347086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:26.347506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:26.348338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:26.348798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:26.350423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242016f-3e79-4d7a-8c4e-65000629287d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:26.362997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 267/540] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:26.375170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:26.483088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905ab06-428b-45ba-ab6d-9655ebf6910f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:26.504725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6360c0-adf4-4115-ac24-6e2ae32f3724 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:26.505611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6360c0-adf4-4115-ac24-6e2ae32f3724 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:26.506616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6360c0-adf4-4115-ac24-6e2ae32f3724 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:26.512869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 268/541] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:19:26.519927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04d5a-40f9-43c8-b016-cadbc81df2c3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:26.520200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04d5a-40f9-43c8-b016-cadbc81df2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:26.520467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04d5a-40f9-43c8-b016-cadbc81df2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:26.531421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:26.532403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:26.532875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:26.533554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:26.535266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=73bcaefa6121424bb28c87f8d8729dad) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:26.536090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:26.538632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:26.554915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 274/542] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:26 2022] GET /identity/v3/role_assignments?user.id=73bcaefa6121424bb28c87f8d8729dad&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:26.556464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-efb04d5a-40f9-43c8-b016-cadbc81df2c3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:26.557914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-efb04d5a-40f9-43c8-b016-cadbc81df2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:26.672661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 269/543] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:27.028162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:27.071656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:27.149164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3a310-5319-4d9e-be85-934ff877be53 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:27.182666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2a49-7f67-48ea-b548-4f63a78125a3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.183352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2a49-7f67-48ea-b548-4f63a78125a3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.183848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2a49-7f67-48ea-b548-4f63a78125a3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.184936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:27.185574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.185897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.186111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.186512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 270/544] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:27.197245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.197879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.198357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.198760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:27.205158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:27.206080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:27.206893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 275/545] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:27.212245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:27.238610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:27.240820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:27.281801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:27.319564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:27.331307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af542198-da6b-4a41-88ab-c9b3ba90b688 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:27.380243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:27.381711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 271/546] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:27.382172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.382666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.383119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.383946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:27.384382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:27.385924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363569c-6698-40af-980b-e22886ea2867 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:27.395558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 276/547] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:27.403257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:27.565845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd47c-00df-478d-9a8d-5bb619649fcb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:27.596542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cf82-9570-468b-9ad9-fff56a7a5a7b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.596542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cf82-9570-468b-9ad9-fff56a7a5a7b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.596542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cf82-9570-468b-9ad9-fff56a7a5a7b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.596542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 277/548] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:19:27.608745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.608745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.608745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.636630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:27.637874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:27.638810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.639327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.639804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.641702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:27.661037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:27.665649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:27.687754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:27.688719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:27.690048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:27.690048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:27.690048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:27.692432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 272/549] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:27.693924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:27.727094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:27.742717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 278/550] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:27.742717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:27.875054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cdb0c-73b6-40d3-ac21-b3240e92dd90 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:27.901021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:27.917936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f48b4-9327-46f3-ac5a-4ebe9d14edb2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:27.951429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:27.952424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.952904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.953392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.976089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:27.976851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:27.980829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:27.981254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:27.981664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:27.982464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:27.982927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:27.984476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:27.986335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:27.987421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:27.988397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:27.994351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 273/551] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:28.000617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.018391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 279/552] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:28.025600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.089219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:28.135748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc94845-09ae-4d16-b353-70d925a4c78f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.183763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.184403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.184685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.184965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.185620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:28.185920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.187328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.201055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 274/553] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:28.201055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.203218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb011-8c85-46e5-a765-303a5b405ab2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.257230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.257869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.258146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.258417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.267289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.268798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:28.281358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:28.282337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:28.283291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:28.286880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 280/554] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:28.288674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.294476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:28.332856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197e42-fade-4009-a349-1eded4aea3aa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.373618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:28.381721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.382857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.385587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.385587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.400006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:28.406831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5872af-68f4-4ad6-9f18-9f41f0e94a10 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:28.407466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:28.408469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:28.409402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:28.411973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:28.413213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.454556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443602-9e55-4472-8962-d34666541681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.455481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443602-9e55-4472-8962-d34666541681 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.455914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443602-9e55-4472-8962-d34666541681 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.456004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443602-9e55-4472-8962-d34666541681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.468523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443602-9e55-4472-8962-d34666541681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.469998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443602-9e55-4472-8962-d34666541681 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-40443602-9e55-4472-8962-d34666541681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:28.485098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:28.486368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:28.488216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:28.488216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:28.488216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:28.490936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:28.491815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443602-9e55-4472-8962-d34666541681 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.540868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5abcc3-8498-4a93-9e8d-6720f31ea93b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.551669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:28.577954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.578678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.579065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.579348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.580102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:28.580462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.581935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456c445-6a53-4b39-b17c-22b5c4487627 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.603399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 276/557] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:28.609403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b271e-283c-4dab-afb2-2d920f1f455f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.609646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b271e-283c-4dab-afb2-2d920f1f455f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.609933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b271e-283c-4dab-afb2-2d920f1f455f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.611607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 277/558] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:28.612321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b271e-283c-4dab-afb2-2d920f1f455f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.613233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443602-9e55-4472-8962-d34666541681 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.652021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.652552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.652834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.653107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.654093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:28.654093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.655539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.669477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 282/559] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:28.669477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.686821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:28.743182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b271e-283c-4dab-afb2-2d920f1f455f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.778831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.779451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.779738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.780014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.780668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:28.780973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.782341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c704d7-ce60-4105-9e14-b77fafe106cd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.794955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 278/560] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:28.796274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.796560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.796831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.802124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517891ee-074c-42b5-a568-39b546b78c3e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:28.815346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:28.816559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:28.823168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:28.844029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:28.844659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:28.844941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:28.845217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:28.911180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 279/561] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:28.912408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:28.926256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:28.927818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:28.964858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.032074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867df4ae-7e6d-4ed9-89ac-e2600e1a6545 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.042177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 283/562] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:29.042177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.057340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.077735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.078445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.078778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.079482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.092411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.093869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a82d448e-da28-46a1-9471-0843affc1d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:29.113078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:29.119091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 280/563] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f16e-3722-46be-b39f-35ac20723792 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f16e-3722-46be-b39f-35ac20723792 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f16e-3722-46be-b39f-35ac20723792 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 281/564] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:29.120094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f16e-3722-46be-b39f-35ac20723792 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.154537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65b19f-894c-404d-ae32-28f86e00958e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.199260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.200667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.200945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.201215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.209705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.211263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.221328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:29.224595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:29.225729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:29.226663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 284/565] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:29.227619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.239031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f16e-3722-46be-b39f-35ac20723792 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.277976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.278652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.278959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.279233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.289709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.291177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d749d647-0544-4083-bf95-b8470fc6db11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:29.306715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:29.307724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:29.308617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:29.308617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:29.308617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:29.308617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 282/566] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:29.310999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.310999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.311451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.332091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:29.332640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:29.342285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.366056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87371c5-74d9-4c6d-a815-6e5750ff54e1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.402947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.403555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.403829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.404096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.404740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:29.405042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.406427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.410360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 283/567] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:29.411343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.419206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 285/568] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:29.424390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.497232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.530440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc427-12c1-4378-96ab-fe51c711d102 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.545882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dded8-7868-43bc-b5db-ce862561c458 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.586891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.587577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.587887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.588063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.594830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.595396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.595685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.596501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.596676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:29.597674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.598992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.605360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:29.610683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:29.611672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 284/569] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:29.613222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.616321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.634353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 286/570] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:29.635121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.745003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447d60-15b0-423d-8f01-87860db297d8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.757736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09460fd5-614c-486c-bcae-a0cee72c0477 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.776989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.783958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.784577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.784849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.785122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.785770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:29.786077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.787516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.799648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 285/571] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:29.809606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.809764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.809764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.809764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.809764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.813173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.814747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:29.829911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:29.831151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 287/572] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:29.832510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.894534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:29.922488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc808f-3028-40b4-86b5-b734e6f0f2a8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.949830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae5de-1939-4d36-a673-fdc36d7eee1a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:29.959243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.959870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.960155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.960422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:29.961111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:29.961414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:29.962858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:29.971516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 286/573] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:29.972461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:29.995547 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:29.996299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:29.996671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:29.997007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.009254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.010667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:30.026620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:30.027708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:30.028704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:30.028704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:30.028704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:30.028704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 288/574] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:30.028704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.042407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.090530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75b0f5-51ea-48b8-9ace-1b0576e27e78 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.126886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.127894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.127894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.128071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.139440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228dc3-a5cf-4cfa-ae61-d10e0a9026a1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.140596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:30.145865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:30.147816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:30.148713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 287/575] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:30.149410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.150186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.179585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.180224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.180498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.181033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.187665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.189132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:30.204291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:30.205433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:30.206361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:30.207071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 289/576] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:30.208150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.260989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00a1f-fdc8-46c7-972d-ad866ed48739 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.282658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.307221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.307838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.308112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.308378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.309120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:30.309419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.310872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.327670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269d97d-4dfd-4ba5-9d71-04fcdebb64e8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.329701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 288/577] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:30.329701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.367203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.367840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.368115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.368383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.383281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.384765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:30.399782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:30.400824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:30.401709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:30.401709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:30.401709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:30.401709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 290/578] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:30.401709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.429038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.449084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b44fc-fba9-4404-b57e-3f5bcaab15b4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.489813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.491460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.491460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.491741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.492449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:30.492757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.494133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.506216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 289/579] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:30.507035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.517377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2761b-04e5-413d-96a8-5bf9d7054813 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.542999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.553816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.554433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.554747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.555018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.555752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:30.556055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.557439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.566296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 291/580] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:30.567170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.626027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852537-efb0-4d7b-ad7b-0003bee2de84 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.660935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.664917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.665527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.665806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.666077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.666793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:30.667104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.668538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.679508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292966e-6ad3-4f1f-9fbf-ebcaf49d3413 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.681915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 290/581] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:30.682768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.718392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.719079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.719365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.719639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.731591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.733054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:30.747845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:30.749338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:30.750314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:30.750314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:30.750314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:30.750314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 292/582] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:30.750314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.789664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.798789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32780-919c-4517-b9d7-27f2ef5375e8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.834649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.835291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.835568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.835827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.836476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:30.836770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.838128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.851932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 291/583] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:30.855669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.866804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b39ca-1efc-40b3-8405-70dce1823b09 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:30.904762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:30.905401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:30.905683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:30.905959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:30.908004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:30.913985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:30.915511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:30.928201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:30.929320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:30.930227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 293/584] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:30.930738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:30.975387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdc519-6a50-4374-8d15-2febda6afd40 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.014196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.014867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.015148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.015420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.027871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.031986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.041728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02acb-91fd-42bf-bd7a-c27f4843cf7d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:31.047590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:31.048588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:31.049473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:31.049473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:31.049473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:31.049473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 292/585] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:31.049696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.053713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.083482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.084898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.085186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.085511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.086254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=bf51aca728a64f6ba4c143377a24b345) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:31.086556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.088026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.095006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 294/586] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:30 2022] GET /identity/v3/role_assignments?user.id=bf51aca728a64f6ba4c143377a24b345&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:31.095897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.171181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.186233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa666625-ddf7-4062-a94d-ee99561eccdf None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.226444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b80c-b0be-43ec-9a58-2a452db0b88a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.234210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.234878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.238852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.238852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.238852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:31.238852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.238852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.258066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 293/587] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:31.259439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.281680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.282506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.282919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.283261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.292565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.294049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:31.306004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:31.307206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:31.308311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 295/588] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:31.308926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.369074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.425019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc4e1-eb7b-4440-9b1e-8a7bad08c42c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.455811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5171-7790-4048-bf96-a02f1ef08594 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.478192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.478941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.480176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.480176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.480393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:31.480703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.482948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.489161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.496889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 294/589] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:31.502731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.513012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.513769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.514053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.514330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.515537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:31.515844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.517288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.540671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 296/590] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:31.541726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.647340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b1ee-62be-4e69-910f-ad0fb90ee28e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.684135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.701597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace1f6-29ec-4e7d-9cb7-33e1afd39330 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.704385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.705486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.705846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.706194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.716741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.718713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:31.737148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:31.738305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 295/591] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:31.739899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.758708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.760057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.760596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.761020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.762112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:31.762762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.764912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:31.793985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 297/592] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:31.793985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:31.848193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.915376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b4db-d2a8-4b8b-a45f-0751d2baa221 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.957436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16cda8-c06e-4946-8e3b-fd0254660fe7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:31.972989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:31.974027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:31.974906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:31.975169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/5704b06613b94c92896a39fc2b24c280/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:31.991735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=5704b06613b94c92896a39fc2b24c280, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:31.993196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.002909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.004038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.004563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.005080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.014764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.017020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:32.033946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:32.035257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 298/593] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:32.036228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.055009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 296/594] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:31 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/5704b06613b94c92896a39fc2b24c280/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:32.055009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.103209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:32.223261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0836a-cb0a-4bac-9e40-c9597e4bec7b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:32.258137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:32.269391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8906db-3ecb-414d-9596-f1248f48f6e9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:32.293596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.294554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.294882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.295168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.312845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.315477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.322225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.322917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.323198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.323470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.324199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:32.324509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.326676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.344302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 299/595] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:32.345175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:32.345860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:32.346818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:32.347702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:32.347702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:32.347702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:32.348301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 297/596] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:32.354438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.517316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:32.517929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce8fa9-0a1b-43d1-9207-5b2cc31f2bcc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:32.538764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8342a6-7d31-4b5e-aaac-4ebcf128da44 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:32.577307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.578273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.578812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.579303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.580623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:32.581048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.582640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.585615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.586512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.587073 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.587487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/68071674452b42839ffac496a902737d/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.616745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=68071674452b42839ffac496a902737d, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.618210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.622053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 300/597] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 24 05:19:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:32.622956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.640877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:32.694831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 298/598] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:32 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/68071674452b42839ffac496a902737d/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:32.697015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.789679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7a08-f5d1-48f4-91b9-7a18c2c21fc4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:32.866995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.868029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.868508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.868979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.869864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:32.872578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.874284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:32.899600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 301/599] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:32.905226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:32.920798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c394346-44e9-4dab-9027-0fdeb0dbbc00 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:32.961655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:32.962299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:32.962577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:32.962898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:32.965922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:32.976411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:32.978106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:33.003644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:33.004828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:33.006439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:33.006439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:33.006439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:33.006439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 299/600] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:33.014218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:33.018247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:33.070271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9f867-cc29-4133-a236-e9c109959b37 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:33.138399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:33.138910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.139263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.139607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.149867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:33.151484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:33.176631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:33.177839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:33.178881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:33.185743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 302/601] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:33.191570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:33.197878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee58cb5-3d77-4589-9405-e55693eee14e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:33.254029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:33.255051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.256092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.256569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.257419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:33.257926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:33.259512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.273459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 300/602] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:33.279777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:33.361267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:33.378892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb766255-e01c-4d03-ba8a-35a85ef3d80d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:33.425336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:33.425710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26ede-20d5-4eaa-8fe8-50cf26e8333c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:33.426143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.426496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.426865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.428460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:33.429787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:33.431382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c066-d41c-4e0a-b6e8-345ce392369c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.433160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:33.447605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 303/603] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:33.449287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1c21-93d6-4a8f-aee1-64a193708e37 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.449593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1c21-93d6-4a8f-aee1-64a193708e37 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.449868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1c21-93d6-4a8f-aee1-64a193708e37 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.454776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 304/604] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:33.455690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1c21-93d6-4a8f-aee1-64a193708e37 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:33.472311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:33.473434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.473723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.474036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.483508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:33.485208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-aa8c4847-9023-460f-86ea-b2f6dc70ff74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:33.501164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:33.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 301/605] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:33.503675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.504324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.505398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.529156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:33.530648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:33.569532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1c21-93d6-4a8f-aee1-64a193708e37 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:33.611825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:33.611825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.611825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.611825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/dddbf44c00e7411db8084d75fee531e1/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.627126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 302/606] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:33.628170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:33.628504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=dddbf44c00e7411db8084d75fee531e1, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:33.630200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.678486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:33.715467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 305/607] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:33 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/dddbf44c00e7411db8084d75fee531e1/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:33.771113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d0696-a22c-430a-a7d3-662b34d2348c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:33.824397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:33.825195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:33.825567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:33.825933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:33.826812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:33.827217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:33.828915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:33.847104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 303/608] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:33.854486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:33.931717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:33.994101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:34.012189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01916c-44db-4a7e-acbe-df429f8c6d78 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:34.057339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:34.058402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.059032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.059450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/73bcaefa6121424bb28c87f8d8729dad/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.076435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=73bcaefa6121424bb28c87f8d8729dad, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:34.078243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:34.118548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:34.122441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7d8c-18ab-48ed-9591-c9196a8be601 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:34.162468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:34.163209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.163563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.163873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.174951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:34.180568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:34.181793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:34.182930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 304/609] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:34.190261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:34.204553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 306/610] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:33 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/73bcaefa6121424bb28c87f8d8729dad/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:34.332157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261715da-9649-430a-90c8-592b0333eb9f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:34.389093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:34.389813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.390096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.390371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.391099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:34.391405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:34.392826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba162467-d5d0-4ba6-bcf2-630b65f6701e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:34.405970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 305/611] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:34.411875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:34.546721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655e64-9998-4585-9279-62c5b44d1ac0 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.546721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655e64-9998-4585-9279-62c5b44d1ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.546721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655e64-9998-4585-9279-62c5b44d1ac0 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.546721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 306/612] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:34.564902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.564902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.564902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.578060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:34.594136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7300-1625-47e3-96c1-ab732019fd59 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:34.601217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:34.602670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:34.628174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:34.699947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:34.700601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.700884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.701155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.723128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:34.725387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:34.747849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:34.748837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:34.749735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:34.749735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:34.749735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:34.749735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 307/613] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:34.751110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 307/614] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:19:34.763058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:34.873426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8546-159a-471e-91fb-1150188a7bc1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:34.917885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:34.918593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:34.918968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:34.919314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:34.920050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:34.920428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:34.921887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:34.944537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 308/615] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:34.951655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.072541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f87d3-5b07-40e6-b279-a09b1541eab5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.126261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.127049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.127401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.127732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.135705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.137513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:35.150358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:35.151391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:35.152346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 308/616] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:35.157408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.171240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.173440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.194296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.325741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb84ab-0a80-45c8-8f2c-2ea3908a1718 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.373860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9241a8-0dad-4bc9-8cd3-77d9ee5ddd06 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.377568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.378402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.378911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.379378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.380326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:35.381369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.383278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841775-1bbc-43b0-89b6-b6afb86590d8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.404074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 309/617] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:35.405583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5966-e80a-4471-9bb0-0261b3c37df7 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.406090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5966-e80a-4471-9bb0-0261b3c37df7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.406559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5966-e80a-4471-9bb0-0261b3c37df7 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.408242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 310/618] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:35.410968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c5966-e80a-4471-9bb0-0261b3c37df7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.425917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b126a05-03e3-4602-bd2f-eab94197fc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.426900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b126a05-03e3-4602-bd2f-eab94197fc8c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.427543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b126a05-03e3-4602-bd2f-eab94197fc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.428014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b126a05-03e3-4602-bd2f-eab94197fc8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.438925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b126a05-03e3-4602-bd2f-eab94197fc8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2b126a05-03e3-4602-bd2f-eab94197fc8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:35.444821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:35.445744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:35.446836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:35.448237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 309/619] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:35.451226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.451507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.451777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.472251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:35.473785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:35.482240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.524204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c5966-e80a-4471-9bb0-0261b3c37df7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.545538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.551502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 310/620] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:35.552884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.561031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.561667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.561943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.562216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.574062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.575695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:35.591928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:35.593399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:35.594289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:35.594289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:35.594289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:35.603558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 311/621] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:35.604616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.673886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d293a-2b95-4e37-bcb8-587eacdbf3ea None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.718740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.719794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.720270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.720774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.721653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:35.722153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.723838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.734407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 311/622] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:35.746792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f95d0-9a7e-44b9-90f7-177d545bf8c0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.748141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.759694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.785189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.785189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.785189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.785189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.785627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:35.785627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.786214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.802836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 312/623] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:35.805931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:35.860340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.926518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e0d3-7e36-4b2d-8c5b-683800e8db74 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.940286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4692b1-c0c1-4d17-b26c-4541ccd9a909 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:35.967432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.968314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.968838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.969246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.977095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.977854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:35.978498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:35.978810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:35.979089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:35.979846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.990830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:35.992424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:35.992585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:35.993634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:35.994721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:36.001458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 313/624] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:36.002609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:36.010559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:36.012051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:36.013133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:36.013133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:36.013133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:36.018755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 312/625] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:36.019752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.046562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.122802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0adb7-caea-4069-a12d-ca280e0c03c7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.142379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4233b-2a1c-47ed-821b-cbc8f9aa0ef4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.157750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.163271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.164109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.164576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.164989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.176264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:36.179692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.180471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.180816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.181157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.181997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:36.182358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:36.183817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:36.184758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:36.185601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:36.186322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70bc6b-88e8-411b-84ff-559cd4cc8557 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.186395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 314/626] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:36.186395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.204493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 313/627] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:36.205594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9785f-e406-45e5-bb4b-b98d25aadbaa None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.205948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9785f-e406-45e5-bb4b-b98d25aadbaa None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.206222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9785f-e406-45e5-bb4b-b98d25aadbaa None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.210754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 314/628] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:36.210754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9785f-e406-45e5-bb4b-b98d25aadbaa None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.303216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.309740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46069-de52-4460-8c87-7290710ebba3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.324540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9785f-e406-45e5-bb4b-b98d25aadbaa None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.347786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.348506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.348786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.349073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.350523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:36.351149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.352806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.360736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.361353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.361627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.362360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.363071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:36.363380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.364771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7fec-bcac-46b2-8f9a-2f0852fbf07d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.370294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 315/629] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:36.370294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.383204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 315/630] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:36.383204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829198-a640-483f-9261-32a1c35ef708 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.383204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829198-a640-483f-9261-32a1c35ef708 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.383204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829198-a640-483f-9261-32a1c35ef708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.399626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-61829198-a640-483f-9261-32a1c35ef708 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:36.400842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-61829198-a640-483f-9261-32a1c35ef708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:36.431031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.480732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 316/631] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:36.481668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829198-a640-483f-9261-32a1c35ef708 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.494728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eabedc-ee78-40a1-bf17-1fad4bca2d4a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.528463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.529138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.529419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.529722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/bf51aca728a64f6ba4c143377a24b345/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.546649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=bf51aca728a64f6ba4c143377a24b345, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.548331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.590956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829198-a640-483f-9261-32a1c35ef708 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.619432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 316/632] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:36 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/bf51aca728a64f6ba4c143377a24b345/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:36.619432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.634889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.664669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.665331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.665610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.665880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.680834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.685796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-67c041df-3bdd-4120-a51a-bcfa86b95dbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:36.709151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:36.710380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:36.711398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 317/633] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:36.711990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b14c6-b046-45d5-833c-e0b4b50c6804 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.711990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b14c6-b046-45d5-833c-e0b4b50c6804 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.712566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b14c6-b046-45d5-833c-e0b4b50c6804 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.717730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 318/634] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:36.718647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b14c6-b046-45d5-833c-e0b4b50c6804 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.750021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.788164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9daf63-02fb-4ff3-8649-913fbefc4bc6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.828552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.829195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.829472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.829743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.839530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b14c6-b046-45d5-833c-e0b4b50c6804 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:36.840604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.842059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-599851b3-6953-46c5-8c72-a39d6150141e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:36.857921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:36.858969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:36.859877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:36.859877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:36.859877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:36.859877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 317/635] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:36.860696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.860696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.860869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.878629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:36.879848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:36.884454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:36.884643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:36.884911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:36.885182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:36.885915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:36.886224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:36.887941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:36.908085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 319/636] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:36.911693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:36.942654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:36.959199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 318/637] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:36.962768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.030261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.055141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b110a7-fc4d-4c70-9ae9-bc69381bd15d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.072874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a61092-d2d2-4003-9719-dc339b3a0ee9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.094155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.095136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.095582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.096063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.109272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:37.113976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:37.115534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:37.116399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:37.118287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.119194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.119777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.120252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.120670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 320/638] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:37.121570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.121949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:37.122849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.124593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.145103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 319/639] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:37.145103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.205016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.258903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a2da-6faf-4d29-8e95-4ddf9a6337dc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.270109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674df55-b4a3-4e12-80f4-9c962d243fb9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.298734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.299307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.299622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.299902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.307519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.308451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.308951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.309359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.310049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:37.310358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.311792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.315852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.327393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 320/640] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:37.328318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.373685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.375286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.435891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883ab5-e95b-47c9-8436-d07f8703d292 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.446398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.472097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.472788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.473069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.473346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.482246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.483848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.485020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 321/641] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:37.486052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:37.499211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:37.500422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:19:37.501512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:37.503314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 321/642] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:37.504236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.543412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.604731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28b4b-ef31-4e9e-a410-fbe89e6e4e82 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.622526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa454ac-db2d-47a0-9058-ab9f9c205f48 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.642009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.642654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.642972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.643247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.654728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:37.658255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.658917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.659201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:37.659434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:37.660403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:37.661251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:37.663184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.663271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 322/643] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:37.663271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.677972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.679859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:37.697352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:37.698634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:37.699880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:37.699880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:37.699880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:37.699880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 322/644] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:37.699880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.730980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.789014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82411990-bc14-434b-8c6e-198fe1f9abe5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.793387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:37.822465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea34ed5-71c4-40c0-995b-106e7348c020 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:37.828372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.829015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.829298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.829573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.842861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.844354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:37.860245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:37.861435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:37.862669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:37.862669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:37.862669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:37.862669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 323/645] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:37.862669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.868733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:37.869420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:37.869767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:37.870104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:37.870951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:37.871326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:37.872830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:37.893328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 323/646] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:37.900972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:37.973747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b977bf-d0f3-44f7-92ee-6e62e1d3de4f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.012824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.014825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.015511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.015798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.016079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.016909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:38.017215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.018574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.027295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 324/647] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:38.027921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.038615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69519f-9c6b-475f-8999-db8f959c8a51 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.047472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.083980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.084957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.085391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.085827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.086633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:38.087112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.088637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.106061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 324/648] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:38.106061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.153948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c74b8-36af-48ef-8308-c285526c3eb6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.190340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.190986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.191269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.191541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.192187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:38.192492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.193905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.206456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 325/649] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:38.207306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.226843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad066-47f1-4432-9ce5-e6a36112a5ae None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.264020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.264771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.265296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.265664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.278283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.294368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.318297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0840-5657-4725-b486-056f7f9ec12e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.339362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.341093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.355030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.355783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.358136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.358136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.367747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.369225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:38.385622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:38.386919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:38.388407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:38.388407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:38.388407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:38.388407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 326/650] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:38.391353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.452970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 325/651] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:38.453916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.498402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.514427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a48abc-c119-438d-9e89-cd6a371e804f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.545935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.553088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.553725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.558453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.558453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.561978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.562461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053d3f3-0f7f-4599-a4e0-36342e32099b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.563440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:38.575439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:38.576450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:38.578020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 327/652] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:38.578770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.611703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.612334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.612610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.612878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.620220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.621660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:38.633106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:38.634532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 326/653] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:38.635458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.684002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9d7f-a490-4c68-aaa6-8e8502c32427 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.717330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.717938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.718215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.718492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.719165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:38.719470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.720825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.733751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 328/654] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:38.734891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.737397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03554-2ee2-4c1a-8c6a-d42a23a529ae None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.739060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.774030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.774551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.774860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.775129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.785814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.787505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.792778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d635de62-92a2-454b-ac81-17e3dfda0ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:38.802737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:38.805291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 327/655] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04afdec-f7e0-4979-a929-dc255ffbaeaa None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04afdec-f7e0-4979-a929-dc255ffbaeaa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.806198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04afdec-f7e0-4979-a929-dc255ffbaeaa None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.807259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 328/656] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:38.807824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04afdec-f7e0-4979-a929-dc255ffbaeaa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.849095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb1758-eabf-423a-a0db-e8a8a7f9c424 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.884730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.885352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.885632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.885950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.886976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:38.887302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.888726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.909534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 329/657] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:38.910293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.917150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04afdec-f7e0-4979-a929-dc255ffbaeaa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:38.953328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:38.953934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:38.954217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:38.954490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:38.955239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:38.955527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:38.956963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:38.970012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 329/658] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:38.970862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:38.986074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.014674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edf96-ed04-49bb-8c4d-4a984802aa19 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.025468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.050197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.050931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.051183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.051655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.059995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.061433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-39a2885c-fe05-422c-9f46-76e99bd0f1d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:39.073039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:39.074070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:39.075067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 330/659] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:39.075685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.075685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.075826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.082419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebbd56-0fd2-4732-bf48-2e824e5765a4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.094372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:39.095687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:39.126885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.127508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.127794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.128061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.128715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:39.129017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.130984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.142677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 330/660] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:39.143560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.173721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 331/661] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:39.176114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.219370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.252352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02791d61-f328-45df-aee0-20556db4e811 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.287657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.290370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.291014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.291293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.291466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572623-ea12-4b6a-ba97-b8cc135e20f4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.291575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.327521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.328135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.328415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.328686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.329412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=5704b06613b94c92896a39fc2b24c280) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:39.329722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.331224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.338506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 332/662] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/role_assignments?user.id=5704b06613b94c92896a39fc2b24c280&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:39.343660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.374046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.375788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.462126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.470002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb86f58-b9b6-4644-a035-4b1af0d75847 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.500545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 331/663] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:39.501257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.517683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.518314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.518683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.518893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.519630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:39.520290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.522081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.542612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 333/664] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:39.544029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.572909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.632788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736be35f-4959-45aa-b1f5-aa6bed09ad7c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.669637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f388a-b7d9-490f-aa86-62b838a38021 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.672015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.672705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.672991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.673265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.681404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.682926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:39.695481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:39.696435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 332/665] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:39.697401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.716798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.717175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.717464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.717740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.729453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:39.732916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:39.734211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:39.735418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:39.736250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:39.740271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 334/666] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:39.741157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.812148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d195d-c72b-4f28-9d71-6406f3b52a10 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.830899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.851183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46cf0-807d-4f0a-a1d3-b0dc6c1c2a01 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:39.852114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.852747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.853022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.853289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.864647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.866235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:39.884513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:39.885504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:39.886403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:39.886403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:39.886403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:39.890482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 333/667] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:39.890591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:39.891220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:39.891333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:39.891502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:39.891769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:39.969736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:39.971216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:39.986517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.003321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906e4c8-c07e-4be7-b502-2e74031efac6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.041126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.041736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.042011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.042279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.042999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:40.043304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.044742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.054486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.058035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 334/668] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:40.058724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.082087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 335/669] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:40.083769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.171520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6855187-7e0c-40f9-9a2d-8625e5c105e5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.186828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc6bec-cf82-4cd8-9109-6de2dc601066 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.208079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.209233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.209584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.209877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.210559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:40.210898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.212311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.220621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 335/670] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:40.221429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.227993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.231599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.231599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.231599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.231599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:40.231599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.232415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.235735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.251221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 336/671] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:40.251221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.294025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.341779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556faac1-e3c6-4e79-a276-27fc76177459 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.357997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2891c2a-de5f-4642-a76e-53a016b3ff1e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.377577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.378187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.378577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.378894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.379633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=68071674452b42839ffac496a902737d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:40.379949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.381821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.387988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 336/672] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/role_assignments?user.id=68071674452b42839ffac496a902737d&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:40.388782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.402187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.403325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.403692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.404033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.416661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.418283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:40.437437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:40.438476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:40.439414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:40.439414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:40.439414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:40.439414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 337/673] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:40.439914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.509472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.558894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023fb45-97d8-4e34-bdac-2a3ed8dc6c11 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.560833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.572651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c695a8-b7f7-436c-8c1e-65d4c0a92e4a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.616625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.617265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.617543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.617809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.627687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.628361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.628640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.628912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.635816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.637584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.638252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.639722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:40.653028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:40.653967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:40.655347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:40.656074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:40.657261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:40.658357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:40.658357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:40.658357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:40.658778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 338/674] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:40.658778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.658943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 337/675] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:40.661231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.777510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1d88-f4cb-43f0-ab83-3aa00432508a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.802309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.805306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3892d8-e9f1-459d-8be5-6daff13dfff5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.814496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.815217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.815497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.815765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.816469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:40.816779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.818814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.837608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 338/676] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:40.838659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.856386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:40.857913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:40.858678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:40.859266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:40.860410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:40.861340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:40.862987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:40.885805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 339/677] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:40.885805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:40.905021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.979692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5cc1c-04f6-4c71-afc3-aed1bb6f8472 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:40.998213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84fbbf-4e98-4225-a1fd-e9b8d83d3e88 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.033815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.034912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.035453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.035888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.037110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:41.037734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.038231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.039035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.039419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.039784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.040013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.040741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=dddbf44c00e7411db8084d75fee531e1) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:41.041142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.042632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.055168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 340/678] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/role_assignments?user.id=dddbf44c00e7411db8084d75fee531e1&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:41.056323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.056503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 339/679] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:41.063780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.154005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:41.212169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:41.222746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205413-131f-441a-b54b-97b93ff86aad None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.258930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e244b-231a-4225-896e-d58b5ba18c89 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.259170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.259704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.259982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.260253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.281702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.295561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:41.310114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:41.311164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:41.312735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 340/680] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:41.314997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.316095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.316575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.317031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.317258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.325857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.330116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:41.342781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:41.343729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:41.344617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:41.347115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 341/681] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:41.354911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.438373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a62a0a-f908-48c3-93bf-bfe9bdf07492 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.449687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:41.477553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bff6c-57b5-4030-8f4c-e81a257141d2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.488220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.489054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.489866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.490285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.491492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:41.491942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.494308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5d7f3-8d2a-4b8a-b86b-8486fc5864f3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.517007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.517752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.518167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.518569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.519380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:41.519818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.520522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 341/682] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:41.526595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439acb39-a15f-41a6-8c36-a495e22575cd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.527612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69bd7-aba6-4709-9155-80adad83dedf None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.528081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69bd7-aba6-4709-9155-80adad83dedf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.529185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:41.529871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69bd7-aba6-4709-9155-80adad83dedf None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.531747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 342/683] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:41.532638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69bd7-aba6-4709-9155-80adad83dedf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.541802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 342/684] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:41.547928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.547928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.547928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.566244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:41.568201 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:41.656005 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 343/685] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:41.657128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.674813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69bd7-aba6-4709-9155-80adad83dedf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.717075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.717952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.718234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.718506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.751117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:41.797752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.799260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.877734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bf95-99f7-4ae5-ba6a-d4fd3040460e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:41.917156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 343/686] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:41.923134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:41.928112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:41.949864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:41.950484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:41.954051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:41.954051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:41.954051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=73bcaefa6121424bb28c87f8d8729dad) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:41.954051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:41.954051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:41.969827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 344/687] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/role_assignments?user.id=73bcaefa6121424bb28c87f8d8729dad&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:41.981104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.001666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:42.056691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafe20-a201-4b51-94c4-6eb929766af1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.095868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9cf24-b38f-4b43-a14b-8d019bb40b5a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.118367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.119422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.119915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.120393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.146750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:42.150239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:42.169739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.170837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.172983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.173525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:42.183842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:42.184855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:42.185753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:42.185753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:42.185753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:42.190476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 344/688] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:42.198472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.202325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:42.208921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:42.209908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:42.210868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 345/689] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:42.216240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.291435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:42.349072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1135f9-d76f-4b7e-8107-b5a5c1962d90 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.359190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bfb0-6bcc-4643-ae0a-83db558b7c63 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.372309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:42.403832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.404082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.404907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.405363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.405824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.406040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.406413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.406781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.407332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:42.407561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:42.407945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:42.408189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:42.409475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:42.409992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:42.419674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 346/690] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:42.426149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.426791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 345/691] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:42.433308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.580199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb09f8-15ad-4bcf-b28a-c63869035a92 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.627735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.629038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.629393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.629898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.641506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:42.642968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c19765-37ba-48b8-ba48-c70dfaefb80a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.643150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:42.658659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-54dc5207-1c07-45b1-a0c0-5c5b969772cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:42.661174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:42.662254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:42.663455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 346/692] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:42.664052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d83f-b41f-4147-90f3-597a08fdaa6b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.665484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d83f-b41f-4147-90f3-597a08fdaa6b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.665484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d83f-b41f-4147-90f3-597a08fdaa6b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.668286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 347/693] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:42.673081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d83f-b41f-4147-90f3-597a08fdaa6b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.693664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.694525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.695142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.695430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.707789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:42.711481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:42.713029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-583b1b07-c15d-4a02-a17c-d0aaad837a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:42.732206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:42.733197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:42.734086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:42.734086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:42.734086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:42.734259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 347/694] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:42.735873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.735873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.736234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.762133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:42.764210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:42.795603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d83f-b41f-4147-90f3-597a08fdaa6b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:42.835929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:42.836550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:42.836780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:42.836977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:42.837672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:42.837972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:42.839431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:42.854786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:42.855608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.865511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 348/696] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:42.866499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:42.972672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:42.983630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b7d0-3e7f-4150-a783-4ce048d8870e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.029747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.030364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.030638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.032249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.032903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:43.033202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.034577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.040249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:43.051276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd8643-0453-4c61-9f0c-1a4b20bfdb60 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.066612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 349/697] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:43.070591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:43.119791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.120312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.120584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.120850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.122054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=bf51aca728a64f6ba4c143377a24b345) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:43.122553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.124012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.141230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 349/698] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:42 2022] GET /identity/v3/role_assignments?user.id=bf51aca728a64f6ba4c143377a24b345&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:43.180286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:43.217944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ec61-c91a-4624-994a-ac5d24445f6e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.282332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.283004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.283279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.283551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.296343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.297827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:43.321797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:43.322893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:43.323874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:43.333971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 350/699] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:19:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:43.336001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:43.357178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:43.365599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7b68-627e-481f-83c7-b5b84492d3d9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.423500 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.424070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.424347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.424616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.440970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.442445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:43.462344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:43.463470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:43.464409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:43.464409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:43.464409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:43.468335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 350/700] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:43.469614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:43.484455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:43.488201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669c2c-6864-4676-b1ca-10011731a164 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.533637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.534524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.535007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.535285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.536046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:43.536886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.538629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00329a7-c691-4417-bd56-b235788e28d5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.561456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 351/701] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:43.562802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfdc3b-0f5b-4682-b7ad-d0141c4a40b0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.563096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfdc3b-0f5b-4682-b7ad-d0141c4a40b0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.563370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfdc3b-0f5b-4682-b7ad-d0141c4a40b0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.568902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 352/702] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:43.568902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfdc3b-0f5b-4682-b7ad-d0141c4a40b0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:43.600982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556a1b0-8e43-4129-84a7-be4d6c36a38c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.647709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.648624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.649052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.649728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.651161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:43.651653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.653918 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:43.654072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33ced-33a5-4fcb-b80f-0f9619035cb3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.672773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 351/703] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:43.674407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.674880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.675290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.696615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:43.698170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:43.699019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfdc3b-0f5b-4682-b7ad-d0141c4a40b0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.742246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.743238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.743801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.744216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.768167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:43.774334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 352/704] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:43.775500 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:43.825844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.827618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.883909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323fccf-5044-4794-a3b0-74dcd62a08dd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:43.911073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:43.922220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:43.922980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:43.923418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:43.923784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:43.924704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:43.926193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:43.963080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 353/705] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:43.969904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.030850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 353/706] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:19:43 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:44.104749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316d76-9228-4fdd-a539-6a1e4f8f1a79 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.117955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.142781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.143438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.143713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.143969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.155790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.157303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:44.177570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:44.178597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:44.179782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:44.179782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:44.179782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:44.184293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 354/707] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:44.185662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.219974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:44.231081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:44.308781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb300-d4d0-41e9-9948-a4776464c496 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.332379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17bd2-4a8e-4d10-840b-8ead940080c1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.348492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.349873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.350216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.350496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.351286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:44.351591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.353918 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.372517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 355/708] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:44.374664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.375822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.376653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.377080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.377681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.379029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.380485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:44.397118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:44.398402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:44.399389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:44.402495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 354/709] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:44.408642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.470776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:44.495210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82fb6-8a13-4ed6-af61-fde47eefddfe None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.533601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3493-de64-4693-b5d1-bcb73ded61db None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.536940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.537578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.537853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.538115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.545983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.547663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.567938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:44.569969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:44.571220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:44.572099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:44.574375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 356/710] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:44.580698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.610534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.610534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.610534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.610534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.611101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:44.611101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.611101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ee4f7-f87a-45a0-bb82-7e709c850e7a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.620625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 355/711] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:44.622168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9a76f-9eb0-48e7-8639-bf91d061d270 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.622458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9a76f-9eb0-48e7-8639-bf91d061d270 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.624942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9a76f-9eb0-48e7-8639-bf91d061d270 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.624942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 356/712] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:44.629085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9a76f-9eb0-48e7-8639-bf91d061d270 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.738348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529204-4ed8-4b39-9f23-b39a6b260fe5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.757018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9a76f-9eb0-48e7-8639-bf91d061d270 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:44.785223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.785839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.786180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.787140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.787842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:44.788077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.790224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a61887-a43f-4497-8524-ee7ea6cd26e6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.798359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:44.799351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.800022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.800503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.801336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:44.802062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:44.804212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:44.804351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 357/713] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:44.805576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:44.805862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:44.806131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:44.818718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:44.819343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 357/714] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:44.820375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:44.844274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:44.845512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:44.947099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:45.008291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 358/715] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:45.023206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3a7d4-b032-491a-b5b0-2d6dbd27c8ad None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:45.062142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:45.063139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:45.063654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:45.064135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:45.065083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=5704b06613b94c92896a39fc2b24c280) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:45.065664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:45.068293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:45.074623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 358/716] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:44 2022] GET /identity/v3/role_assignments?user.id=5704b06613b94c92896a39fc2b24c280&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:45.305555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:45.437764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7d020-3cee-499a-9daa-47c2ef2edcd6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:45.481147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:45.486963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:45.487658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:45.487938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:45.488270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:45.488869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:45.490802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ed3ea330-a7c0-4fce-a55d-c533373df1d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:45.508242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:45.509517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:45.510373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:45.511153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 359/717] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:45 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:45.515553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:45.651142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96cdbb-c552-4bf7-a957-01fc02ed7077 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:45.651492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96cdbb-c552-4bf7-a957-01fc02ed7077 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:45.651756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96cdbb-c552-4bf7-a957-01fc02ed7077 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:45.653370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 360/718] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:45.659279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3b462-d1da-4087-996c-d8a91a5a2c68 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:45.659556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3b462-d1da-4087-996c-d8a91a5a2c68 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:45.659837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3b462-d1da-4087-996c-d8a91a5a2c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:45.684821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cb78e-17c1-4f59-ae32-11215a0b2f80 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:45.701325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:45.715767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-41e3b462-d1da-4087-996c-d8a91a5a2c68 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:45.716974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-41e3b462-d1da-4087-996c-d8a91a5a2c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:45.727923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:45.728654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:45.729015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:45.729475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:45.730200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] RBAC: Adding query filter params (name=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:45.730584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:45.732203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:45.737318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 359/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:19:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:45.744492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:45.860507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577953f-0cf0-4c41-9f2f-6462a8017139 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:45.904979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:45.906122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:45.906613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:45.907121 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:45.907991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] RBAC: Adding query filter params (type=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:45.908496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:45.910105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:45.916576 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 360/720] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:19:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:45.944734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 361/721] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:46.394531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:46.454951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:46.507026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83bdc-b879-4088-a913-18f72adb6667 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:46.508005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83bdc-b879-4088-a913-18f72adb6667 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:46.508485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83bdc-b879-4088-a913-18f72adb6667 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:46.510291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 362/722] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:46.528573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:46.528881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:46.529137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:46.529328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bc2df-6826-435a-93a5-fc6bb571e645 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:46.564369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:46.564986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:46.565103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:46.565264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:46.565536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:46.566180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:46.576647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:46.582016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:46.583090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:46.584169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 361/723] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:46.592953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:46.724652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 363/724] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:46.735007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:46.737035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0c245-f32f-49db-bfc6-afd25eadeb04 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:46.786825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:46.787916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:46.788376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:46.788798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:46.789617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:46.790071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:46.791619 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:46.800974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 362/725] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:46.806866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:46.868027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:46.915715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b57c-fa55-4c27-a8cc-b68871aa0105 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:46.952963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:46.953603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:46.953886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:46.954161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:46.965353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:46.966853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:46.982444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:46.983489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:46.984405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:46.984405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:46.984405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:46.984405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 364/726] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:46.990159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.071238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.143900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af6aa6-64a2-4e58-b861-1dc5a8509a29 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.210441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.211467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.211950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.212569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.214150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:47.214893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:47.217254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:47.241463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 363/727] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:47.247473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.257023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eac37-1782-4b99-804f-bc205fca7415 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.274748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:47.279198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:47.331739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d14fc-0578-4067-8696-0aa9e6ab7e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.332382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d14fc-0578-4067-8696-0aa9e6ab7e78 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.332669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d14fc-0578-4067-8696-0aa9e6ab7e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.333111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d14fc-0578-4067-8696-0aa9e6ab7e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.355183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d14fc-0578-4067-8696-0aa9e6ab7e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e80d14fc-0578-4067-8696-0aa9e6ab7e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:47.365559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:47.366599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:47.367535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 365/728] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:47.368265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c8c8b-fe65-433a-a26f-056a01017870 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.368901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c8c8b-fe65-433a-a26f-056a01017870 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.368901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c8c8b-fe65-433a-a26f-056a01017870 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.373653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 366/729] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:47.374804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c8c8b-fe65-433a-a26f-056a01017870 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.390317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d95bc-92ed-474a-99ad-cab01aa91c45 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.430262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.430923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.431207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.431474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.439074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:47.440936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-23c4980c-37c2-4fa8-9773-e2fbdbaa1091 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:47.454262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:47.455340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:47.456294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:47.459033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 364/730] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:47.461068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.461581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.461866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.481811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:47.483361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:47.485403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c8c8b-fe65-433a-a26f-056a01017870 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.523531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.524140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.524356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.524593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.525261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:47.525566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:47.526968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db236d2-fe99-47f6-8a8b-428fa29951d9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:47.535933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 367/731] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:47.537589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d31ec-b2a0-43cf-851c-f5f65b58537b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.537881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d31ec-b2a0-43cf-851c-f5f65b58537b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.538159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d31ec-b2a0-43cf-851c-f5f65b58537b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.542836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 368/732] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:47.542836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d31ec-b2a0-43cf-851c-f5f65b58537b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.565656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 365/733] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:47.571621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.581027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:47.592823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:47.668655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d31ec-b2a0-43cf-851c-f5f65b58537b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.709570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.710351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.710628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.710927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.711726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:47.711970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:47.713425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd04573-82a2-4958-aeeb-d97ec98b703d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:47.724662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2605a4-4034-493e-9cd2-6e99da6004c2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.736718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 369/734] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:47.738095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.738458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.738655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.757983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:47.759316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:47.772118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.773126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.773629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.774227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:47.788278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:47.790330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:47.809254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:47.810268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:47.811271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:47.811271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:47.811271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:47.813868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 366/735] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:47.814649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.839673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 370/736] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:47.840929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:47.865394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:47.902474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:47.952092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14198f0-c8e3-48dc-b68c-d956d6a4b024 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.967107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a48a07-dfd2-4047-a329-a47c6c8a9adc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:47.993045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:47.994007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:47.994471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:47.994969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.016019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.016748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.017491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.017845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.018778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:48.019240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.021064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.042004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 371/737] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:48.042004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.089195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.091085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.139781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:48.166377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:48.166724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910c12-8559-4114-ac97-7532030b2c19 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.208574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 367/738] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:48.208771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.209424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.209704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.210053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.210550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.210744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.212104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.310953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 372/739] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:19:48 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:48.311154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.321764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61c04c-9380-409b-88d9-a5d0ff210bef None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.386907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.387830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.388398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.388836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.399659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.401382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:48.415964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:48.417024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:19:48.417985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:48.420272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 368/740] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:48.421318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.444728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b295ae3-18b9-403e-9684-ff6523b1116b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.449791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:48.495040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.495427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.496154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.496154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.504468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:48.512215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:48.518424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:48.519433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:48.521043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:48.524170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 373/741] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:48.529603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.559055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c7d5-d1ac-4a8a-aec3-fe31ca3d478e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.601480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.602128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.602400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.602673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.615854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.617478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:48.636777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:48.637793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:48.638665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:48.638665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:48.638665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:48.638665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 369/742] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:48.638928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.654740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf36d-54d1-4188-9aa2-8eebcfaa0b27 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.689580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.690192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.690469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.690763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.691507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:48.691810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.693432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8bbca-1be4-4787-9551-f2579a171f24 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.716510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 374/743] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:48.716510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5162-8935-4cee-9595-f8c45a997770 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.716510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5162-8935-4cee-9595-f8c45a997770 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.716510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5162-8935-4cee-9595-f8c45a997770 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.716510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 375/744] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:48.716510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5162-8935-4cee-9595-f8c45a997770 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.726680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:48.760656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b536-093f-469b-bbf1-1ba906ca8943 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.784606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:48.799538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.800251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.800553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.800842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.801706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:48.802445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.803426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.824691 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 370/745] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:48.824691 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:48.844742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5162-8935-4cee-9595-f8c45a997770 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.885158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.885683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.886005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.886220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.887175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:48.887473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:48.888854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e557-23f0-46da-895e-8fe56032f6ef None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:48.901725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 376/746] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:48.902529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.902857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.903129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.923408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:48.924828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:48.942635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc4d72-0b41-4820-83a7-307f876f5ab8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:48.980744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:48.981360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:48.981641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:48.981913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:48.984638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.002875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 377/747] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:19:49.002875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.064324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.066064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.069665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.133619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457ecd-ccb2-482e-ad47-01cb2f112bfd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.179486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.180773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.181294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.181728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.196535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 371/748] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:49.196535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.199112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.200965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:49.220633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:49.221648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:49.222544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:49.222544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:49.222544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:49.224713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 378/749] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:49.225678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.248982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.324362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e47f1-70b7-4336-b49a-bada1a14b7bb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.351875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.356135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d11efa-274b-4346-b733-eddefc7ea72c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.361518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.362167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.362442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.362747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.372096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.373536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:49.385605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:49.386890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 372/750] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:49.387817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.401096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.401730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.402017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.402273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.414270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.415756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:49.430935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:49.431931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:49.432852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:49.432852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:49.432852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:49.436513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 379/751] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:49.437203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.498667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.507301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1d95-f78f-4c4f-8b85-65a9f195d92d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.542733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.543349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.543631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.543906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.544551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:49.544856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.546219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.554440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98578d-dee4-4d80-a125-e5e61e725d0b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.558736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 373/752] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:49.558736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.598981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.600588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.600588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.600865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.601526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.603060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.659421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 380/753] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:19:49 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:49.660315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.682744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.685461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb03854-3beb-46ca-92ee-7107d2258ea4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.734033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.734659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.735062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.735338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.736125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:49.736544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.739852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.760902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 374/754] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:49.762756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.782409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:49.815841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070210-af61-4936-97b0-68bd9e65bff0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.872912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.873678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.874018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.874264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.875433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:49.875746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.877081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.891465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 381/755] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:49.892275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:49.910918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb9481-3910-4162-b152-148b26f1d777 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:49.953378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:49.954227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:49.954507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:49.954813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:49.964911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:49.966814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:49.976229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:50.024219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aad14-1a7a-4bf8-b8d3-cbcdad324737 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.071349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.071981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.072254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.072518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.073273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=bf51aca728a64f6ba4c143377a24b345) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:50.073578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.075063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.081884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 382/756] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/role_assignments?user.id=bf51aca728a64f6ba4c143377a24b345&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:50.083442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:50.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:50.126599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:50.127582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:50.131551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 375/757] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:19:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:50.143878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.208374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73409baf-ff20-4719-acff-b721ad342b26 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.251552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.252819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.253109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.253418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.256828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:50.262940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.264965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:50.280077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:50.281046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:50.281928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 383/758] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:50.287564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.311966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:50.361452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6dcc-2cdd-4457-90ae-e514ab998a82 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.400355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.401031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.401309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.401577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.402626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:50.403407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.405160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834c3f-dcea-4302-9b3d-be573c176827 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.409451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf042f8-7093-4adf-988e-a01aa9ca87b0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.429637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 376/759] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:50.431006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f765dc-df87-474d-8bbf-633a94ec35da None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.431289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f765dc-df87-474d-8bbf-633a94ec35da None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.431557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f765dc-df87-474d-8bbf-633a94ec35da None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.433020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 377/760] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:50.439662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f765dc-df87-474d-8bbf-633a94ec35da None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.462869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.463495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.463834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.464351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.465067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:50.465371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.467336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9923f-87a5-44c6-86cd-3e976bc89b1c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.486777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 384/761] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:50.488395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.489075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.490321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.514376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:50.516135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:50.578684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f765dc-df87-474d-8bbf-633a94ec35da None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.588949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:50.623520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 385/762] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:19:50.624958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.626682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:50.638731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.638731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.638731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.638731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.644454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.646071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:50.661736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:50.662777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:50.664109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:50.664109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:50.664109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:50.664109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 378/763] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:50.675772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.760129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c8925-877c-4be3-b75d-05fd237a2f03 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.796535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.797494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.797975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.798447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.799416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=356dc6f47f454900ba6a7b7ee7a481fa) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:50.799973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.802205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.808595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 386/764] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/role_assignments?user.id=356dc6f47f454900ba6a7b7ee7a481fa&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:50.888313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c17c-62b2-4189-94bf-b1063fc6140c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:50.944305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:50.945348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:50.945833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:50.946303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:50.947229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:50.947739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:50.949350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:50.974214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 379/765] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:50.979333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:50.980976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.034564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:51.051379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:51.146047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503d4ba-18fe-4d26-a7c5-9aa65a357ab1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.166142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0b78c-3c23-47ca-8eac-62f956f46c22 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.216792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.219027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.219302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.219567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.220161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.224791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.230793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.236468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.236468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.236468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:51.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:51.242364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:51.243230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:51.247481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.248942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.249663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 380/766] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:51.258520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:51.277642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:51.279877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:51.282050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 387/767] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:51.284854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.401168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e23512-a260-4cb2-8f1c-2a508862d216 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.411735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:51.438646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.439391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.439680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.439944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.440578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:51.440875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.442435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.448590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 381/768] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 05:19:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:51.455876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.463785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2309d4-c3df-4f71-8c49-cf5b0225c382 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.486724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:51.525760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.526806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.527292 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.527776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.528766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:51.529281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.531106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.556572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 388/769] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:51.561134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.578871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb535ec-193d-4bdc-91ab-5829c51eb9b4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.656186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.657175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.657656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.658154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.659018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:51.659560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.661934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.673963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 382/770] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 05:19:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:51.683711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.698464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f48dc7-4668-44f7-9d1f-d3ac6a596dcd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.745039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.747600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.748247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.749682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/5704b06613b94c92896a39fc2b24c280/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.752841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=5704b06613b94c92896a39fc2b24c280, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.755705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.760579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:51.825732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 389/771] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:51 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/5704b06613b94c92896a39fc2b24c280/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:51.857734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e9310-c08a-4e83-9d54-a1b2f4fed03d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:51.912670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:51.913387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:51.913676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:51.913882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:51.914527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] RBAC: Adding query filter params (interface=public, service_id=306e39535b694fd1bfa8e542b08ed979, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:51.914861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:51.916227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052d94-9b81-46c9-8ac5-0868ac9479ef None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:51.930404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 383/772] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:19:51 2022] GET /identity/v3/endpoints?service_id=306e39535b694fd1bfa8e542b08ed979&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:51.935881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:51.986087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:52.074923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1d760-d602-4683-8fef-4f331f3d2bc7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:52.075591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1d760-d602-4683-8fef-4f331f3d2bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:52.075930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1d760-d602-4683-8fef-4f331f3d2bc7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:52.077340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 384/773] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:52.083103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86873d9f-1c45-4aaa-abb2-eab5890a318f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:52.083588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86873d9f-1c45-4aaa-abb2-eab5890a318f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:52.084069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86873d9f-1c45-4aaa-abb2-eab5890a318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:52.088989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc2f4-e5f7-4dbe-b838-fffbe8439bf0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:52.116050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-86873d9f-1c45-4aaa-abb2-eab5890a318f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:52.117258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-86873d9f-1c45-4aaa-abb2-eab5890a318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:52.138490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00f40f-2fe7-48c5-83d9-2e3d507aefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:52.139462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f40f-2fe7-48c5-83d9-2e3d507aefb6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:52.139926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f40f-2fe7-48c5-83d9-2e3d507aefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:52.140398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f40f-2fe7-48c5-83d9-2e3d507aefb6 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:52.141211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00f40f-2fe7-48c5-83d9-2e3d507aefb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:52.142810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00f40f-2fe7-48c5-83d9-2e3d507aefb6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:52.150512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 390/774] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:19:51 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:52.256877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 385/775] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:19:52.501460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84dae-de0e-4bf3-a5cd-7e617513fed4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:52.501843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84dae-de0e-4bf3-a5cd-7e617513fed4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:52.502020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84dae-de0e-4bf3-a5cd-7e617513fed4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:52.503632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 391/776] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:52.509482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:52.509763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:52.510041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:52.529160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:52.530422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:52.554543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:52.576915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84dae-de0e-4bf3-a5cd-7e617513fed4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:52.608385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 386/777] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:19:52.727986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:52.744911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84dae-de0e-4bf3-a5cd-7e617513fed4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:52.795144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:52.795704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:52.795983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:52.796253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] PATH_INFO: `/v3/services/network` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:52.796839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:52.798221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:52.813791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:52.815054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:52.817389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 392/778] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:52 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:52.823004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:52.937464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.012883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b2de-fc48-435f-8969-331af63f2920 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.089104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.090140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.090612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.091282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.092231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] RBAC: Adding query filter params (name=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:53.092730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:53.094322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:53.100509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 387/779] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:19:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:53.105852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.127578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd986-0349-40b5-acbf-038dc0e946eb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.150546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:53.203828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.204484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.204760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.205027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.239997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:53.245349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:53.246356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:53.247235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:53.259937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 393/780] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:53.263744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.282331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b9a3-a06f-4f7b-8c05-23a29a564575 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.324269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:53.339689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.340287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.340759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.341238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.342266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] RBAC: Adding query filter params (type=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:53.342578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:53.344300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:53.361706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 388/781] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:19:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:53.384483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.448059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3f1c3-0ec7-4294-8e36-25266ec7aacf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.502074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.502780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.503066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.503338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.504022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:53.504941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:53.506583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:53.527195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:53.527390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 394/782] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:53.531733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393cfa-f057-400f-83d4-de24caafef03 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.532869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.576138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.576763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.577045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.577319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.578037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] RBAC: Adding query filter params (interface=public, service_id=b64f1b3262324b97b85047732fe853b1, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:53.578346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:53.579744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:53.590705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 389/783] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:19:53 2022] GET /identity/v3/endpoints?service_id=b64f1b3262324b97b85047732fe853b1&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:53.599741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.700925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:53.731069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e3bd-e7ae-4505-96f0-4dd5350a49b5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.747057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a19ac0-569b-4d0c-ad49-002737a40a06 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:53.785427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.786466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.787042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.787475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.787705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c0f7-80f2-4596-b8c9-5e264ae4b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:53.788447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c0f7-80f2-4596-b8c9-5e264ae4b528 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.788818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c0f7-80f2-4596-b8c9-5e264ae4b528 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.789192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c0f7-80f2-4596-b8c9-5e264ae4b528 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.789911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3c0f7-80f2-4596-b8c9-5e264ae4b528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:53.791485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3c0f7-80f2-4596-b8c9-5e264ae4b528 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:53.797621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 390/784] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:19:53 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:53.799056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc34af-22a5-410f-a9a6-b03f92b4fa98 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.799426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc34af-22a5-410f-a9a6-b03f92b4fa98 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.799766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc34af-22a5-410f-a9a6-b03f92b4fa98 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.805847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 391/785] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:53.806065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:53.806065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:53.808052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:53.808338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:53.808614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:53.828617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:53.829908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:53.830860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:53.831782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:53.831782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:53.831782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:53.831954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:53.835985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 395/786] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:53.842840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:53.844098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:53.969164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 392/787] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:19:54.026890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae6b4-82ca-4c3e-a942-ffaa97400c57 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.057081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:54.062758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32316250-fee8-416a-a872-32fb35354515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:54.063379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316250-fee8-416a-a872-32fb35354515 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.063661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316250-fee8-416a-a872-32fb35354515 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.063935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316250-fee8-416a-a872-32fb35354515 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.064590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32316250-fee8-416a-a872-32fb35354515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:54.064893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32316250-fee8-416a-a872-32fb35354515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:54.066337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32316250-fee8-416a-a872-32fb35354515 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:54.081071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 396/788] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:54.086916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.121804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a16b4-6a59-4b49-b0b5-1a059d58c12d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.122122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a16b4-6a59-4b49-b0b5-1a059d58c12d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.122295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a16b4-6a59-4b49-b0b5-1a059d58c12d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.123952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 397/789] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:54.128893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.129021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.129785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.213149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc905-0280-473b-8e68-c01ef3313dce None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.253654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:54.255332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.255855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.256335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.265390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:54.267247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:54.281445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:54.282456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:54.283453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:54.286506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 393/790] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:54.296639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.299992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:54.302574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:54.302777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:54.394840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 398/791] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:19:54.397226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.480658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444599-920c-41f2-94f5-fe8efe225e41 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.536938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:54.536938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.536938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.537308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.538645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:54.539113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:54.540647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:54.570382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ceb6-edaf-436a-ba7e-e9871a9115ad None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.583953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 394/792] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:54.588913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.596082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:54.616416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:54.617469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.617960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.618462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.630665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:54.636196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:54.637410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:19:54.638243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:54.640959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 399/793] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:54.647425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.719849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:54.775273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362e56-fa69-4198-97b0-b4e1e771a3f3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.810522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7df1-4871-429a-b3c4-14c19ea92fa2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.812785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:54.813426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.813710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.813984 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.825088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:54.826539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:54.842886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:54.843877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:54.844761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:54.844761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:54.844761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:54.844761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 395/794] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:19:54.844761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.856421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:54.857331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.857331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.857612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.858240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:54.858544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:54.859954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0cb4-4985-4239-929c-3a4cc1d156f1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:54.874126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 400/795] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:54.874126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113a773-055e-458a-92bf-7f2533a97bc1 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:54.874126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113a773-055e-458a-92bf-7f2533a97bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:54.874126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113a773-055e-458a-92bf-7f2533a97bc1 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:54.874126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 401/796] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:54.874126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113a773-055e-458a-92bf-7f2533a97bc1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:54.923356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:54.963548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8f27-d667-42d1-aa4e-78280bfc98ca None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:54.978433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:54.991754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113a773-055e-458a-92bf-7f2533a97bc1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.002884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.003694 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.003979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.004879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.016513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:55.022795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:55.023758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.024656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 396/797] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:55.025879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.033514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.034133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.034416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.034687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.035368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:55.035702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.037129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6789782-f4e2-4441-8d11-c213f49d2801 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.048482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 402/798] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:55.049669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.049951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.050224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.069401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:55.070599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:55.140758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631d4e-2690-42ca-8656-4fa295373740 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.145701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 403/799] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:19:55.147647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.180095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.180688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.180921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.181330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.184490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.195059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.200334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:55.212787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:55.213870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:55.214896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:55.214896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:55.214896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.219343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 397/800] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:55.220387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.249029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.267030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be3cbd-aa89-4334-8662-23f1805018a9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.306000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.307050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.307609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.308075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.309038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:55.309554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.311160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.320934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 404/801] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:55.322130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.331621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97a01-b805-4896-b58e-2fe0d4e6f46f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.368944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.369578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.369857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.370128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.377196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.378629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:55.390726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:55.391662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.392554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 398/802] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:55.393050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.430523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.438066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea6da-d174-4863-b36e-82d5fe529de3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.473612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.474222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.474505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.474807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.475436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:55.475737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.477119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.495896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 405/803] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:55.495896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.496876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.515319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c13db-d8d7-42e7-bf20-a5618314c32c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.552905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.553972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.554447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.555319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.567521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.568982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:55.586069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:55.587311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:55.589080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:55.589080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:55.589080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.589080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 399/804] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:55.589080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.613059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce64-2130-4e08-a555-d5f9f9c84ad8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.649986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.650653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.650962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.651232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.651934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:55.652238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.653682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.672158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 406/805] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:55.672158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.686809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.711897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317697b4-f49b-4ae2-bbb9-8ff6b8a5fa56 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.748392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.749030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.749308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.749581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.750253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.751564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.755687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:55.762514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:55.763607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:55.764455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 400/806] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:55.765240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.782124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3b3a-131d-4881-a852-87399bc502ee None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.818634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.819330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.819568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.819843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.828436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.829900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:55.845247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:55.846268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 407/807] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:55.847241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.880469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cae416-37eb-4fcb-8969-a0e822585a46 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:55.918359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:55.918998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:55.919281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:55.919553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:55.920194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:55.920498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:55.921847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:55.931156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.935638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 401/808] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:55.936471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:55.963113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021757e-a807-49e7-a634-8c082937ca52 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.006830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.009950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.010865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.011606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.012056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/bf51aca728a64f6ba4c143377a24b345/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.014233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=bf51aca728a64f6ba4c143377a24b345, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.015917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.047993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32f6a6-b9cc-40fc-bc2b-2ad44af1bb01 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.074854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 408/809] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:55 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/bf51aca728a64f6ba4c143377a24b345/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:56.075689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.083274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.083942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.084399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.084848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.086017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:56.086568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.089200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.100243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 402/810] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 05:19:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:56.100243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.204647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bbd47-ee14-4e5c-8520-d66947c5520d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.219089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c613940-b0c2-4ff9-a29f-019ada0af529 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.248427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.250201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.250875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.251175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.251427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.252177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:56.252482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.253958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85102-3ccc-40a8-be32-e9dc44a1d26f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.256270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.260033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.260674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.260957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.261235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.269311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.271012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.273948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 409/811] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:56.275304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d7eaa-23ef-407c-8ce8-879b9293740a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.275587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d7eaa-23ef-407c-8ce8-879b9293740a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.275859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d7eaa-23ef-407c-8ce8-879b9293740a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.277316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 410/812] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:56.278024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d7eaa-23ef-407c-8ce8-879b9293740a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:56.285060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:56.287031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:19:56.288059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:56.289534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 403/813] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:56.290510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.393215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d7eaa-23ef-407c-8ce8-879b9293740a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.401722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7bfe7-3534-4cf9-b868-a2b6948bdc36 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.429763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.430378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.430655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.430953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.431594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:56.431893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.433268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b63138-bd19-4fcc-b749-5f2040ca8665 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.438444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.439243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.444521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.444677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 411/814] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:56.444796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.444885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.444885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.444885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.456155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.457821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.460556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:56.461871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:56.473417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:56.474967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:56.476212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:56.476212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:56.476212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:56.476212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 404/815] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:56.479779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.518879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.527747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.546180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 412/816] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:19:56.553188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.610681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5a00-4a7f-42b3-b28f-332ab05d62e0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.656369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.657550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.657826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.658091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.658870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:56.659154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.660651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.661294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104e8c1-c697-4cfb-af92-948cb935294c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.683114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 405/817] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:56.683114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.708153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.708773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.709052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.709323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.710126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.711447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.790127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.796845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ad08-bd6f-4c81-b0fd-f249c129ec05 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.824610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 413/818] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:19:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:56.824610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.856834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.857825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.858148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.858427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:56.859130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:56.859436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:56.860842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:56.879649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 406/819] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:56.880712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:56.886915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.955240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7691e98-5f09-4258-8c6f-8d664e4e6eae None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:56.996653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:56.997408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:56.997851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:56.998231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.021876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcd039-14a2-4f93-850b-fbaa2ec98688 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.059315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.059882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.060158 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.060428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] PATH_INFO: `/v3/services/network` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.061020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.062369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:57.072274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:57.073319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:57.074189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 407/820] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:57.075235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.086224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.088163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.091764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.146910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.194676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07a807-6299-4143-a867-df95c6c9a853 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.210615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 414/821] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:19:57.211828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.235695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.236343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.236630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.236907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.245240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.246686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:57.262643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:57.263654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:57.264558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 408/822] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:57.265107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.327096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b4a7-9420-4e4c-a284-5cdd53ada6f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.350311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.364683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.365575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.366035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.366509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.367378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] RBAC: Adding query filter params (name=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:57.367857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.369427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.376348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 415/823] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:57.377450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.381063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed7b67-90bc-4739-aac6-11f9769a2032 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.388056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.420334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.420967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.421306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.421601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.435043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.436228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:57.452415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:57.453433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:57.454356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:57.454356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:57.454356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:57.454356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 409/824] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:57.454741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.507600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ca65-ffac-4232-9f39-2ed2455b7b45 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.544863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.545755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.546182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.546598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.547469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:57.547923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.549528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.562620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 416/825] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:57.563762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.570293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ad4d0-0bd0-4b21-9d36-1a6318d8ca9b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.603178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.619848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.620489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.620763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.621041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.621743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] RBAC: Adding query filter params (type=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:57.622050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.623446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.630887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 410/826] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:57.631492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.641054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.680404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd187-a05e-4e3d-9635-a54d6d59a673 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.717237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.718098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.718526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.718976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.719806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:57.720257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.721778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.734793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 417/827] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:57.735905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.746399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c614f-e4c9-4cf5-9c90-4de9a35d3368 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.787423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.788099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.788409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.788654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/356dc6f47f454900ba6a7b7ee7a481fa/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.806737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=356dc6f47f454900ba6a7b7ee7a481fa, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.808437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.845390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4eec8d-a62a-4966-9d61-c2e72b2dfc62 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:57.873762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.884041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad160-945d-421e-a043-ac2d39c494c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:57.884748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad160-945d-421e-a043-ac2d39c494c3 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:57.885128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad160-945d-421e-a043-ac2d39c494c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:57.885476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad160-945d-421e-a043-ac2d39c494c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:57.885836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 411/828] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:19:57 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/356dc6f47f454900ba6a7b7ee7a481fa/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:19:57.886582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad160-945d-421e-a043-ac2d39c494c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:57.887399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:57.888242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad160-945d-421e-a043-ac2d39c494c3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:57.952825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:57.973462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 418/829] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:19:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:19:58.036420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1929d7-409a-4982-837a-ddfdaab80fa3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:58.089369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:58.090290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.090748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.091171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.099727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dce8c-e48e-430b-b351-3dc468df5721 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.100183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dce8c-e48e-430b-b351-3dc468df5721 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.100592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dce8c-e48e-430b-b351-3dc468df5721 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.101504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:58.102154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 419/830] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:19:58.103347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:58.108699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.109114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.109490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:19:58.120032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:58.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:19:58.122338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:58.124649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 412/831] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:58.130289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:58.139980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:58.141374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:58.251291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:58.260120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbd088-b255-4f57-90fc-0d8edb9249c7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:58.262879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 420/832] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:19:58.297669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:58.298374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.298745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.299093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.299868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:58.300250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:58.301801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:58.314650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 413/833] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:58.320681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:58.446084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406fce3-ee1b-4c82-af2e-79c1885573f4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:58.460971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:58.485455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:58.486174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.486525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.486895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.487732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=5704b06613b94c92896a39fc2b24c280) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:58.488116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:58.490153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:58.497477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 421/834] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:19:58 2022] GET /identity/v3/role_assignments?user.id=5704b06613b94c92896a39fc2b24c280&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:58.579329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:58.694994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3821803-a4e7-4ffb-b928-2891ff2844bb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:58.730992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:58.731726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.732078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.732423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.743638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:19:58.749077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:58.750170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:19:58.751350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:58.753635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 414/835] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:58.762724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:58.869776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a546-1fcc-4833-9da7-6d3b730d9063 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:58.906198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:58.907001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:58.907381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:58.907839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:58.908613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:58.909055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:58.910633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834dcf-8929-44b7-a3ec-b0ca16d0d40e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:58.920206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 422/836] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:58.928439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:58.947821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:59.035974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34f4a6-bb4b-4555-8101-2e1c31e6e800 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.065903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41a11-e3eb-4619-bfb5-cdfaa016e8b5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.066197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41a11-e3eb-4619-bfb5-cdfaa016e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.066575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41a11-e3eb-4619-bfb5-cdfaa016e8b5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.069168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 423/837] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:19:59.074904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.075274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.075568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.076767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.077559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.077992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.078402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.089663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:59.091345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:59.094773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:19:59.095983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:19:59.107212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:59.108378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:19:59.109463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:19:59.109463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:19:59.109463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:59.111233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 415/838] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:59.118733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.145264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:59.198991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 424/839] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:19:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:19:59.207970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:59.244472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1a165-8f24-42a6-99c4-8f202c7e04bc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.280969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.282372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.282954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.283459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.284302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:59.284807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:59.286977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:59.300117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 416/840] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:59.306103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.412857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b436f2-e1b5-4307-abde-1b9874760a2a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.449305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.450317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.450849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.451321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.459283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:59.461021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:19:59.474511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:59.475521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:19:59.476564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:19:59.478939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 425/841] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:59.480143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.487724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.522834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:59.617186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aab06-9a35-47f9-99e4-4cbf94c27d9d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.625469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33847bc4-14cd-4caa-9346-6f8f1a16a963 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.653432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:59.673792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.674430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.674720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.674997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.675584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:59.677013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:59.679312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.680063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.680492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.680869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.681717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:59.682128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:59.683679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:19:59.687418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:19:59.688484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:19:59.689314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 417/842] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:19:59.695676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.709294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 426/843] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:19:59.715044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.822761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c35372-ffbb-4d25-ad87-00ed6c015119 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.831261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:59.852506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85800d5a-3d4f-4de5-ab7d-c59e63970845 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:19:59.868951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.869792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.870169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.870740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.871521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:19:59.871928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:19:59.873992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:19:59.886735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 418/844] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:19:59.889013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:19:59.913630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:19:59.915491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:19:59.916233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:19:59.916955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:19:59.967216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.001301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:00.002787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:00.015146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692326-b94d-436f-ace3-2ce8166d8549 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.051683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:00.052362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.052638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.052907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.053563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:00.053837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:00.055227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70a3ab-7a32-4724-bd96-781d680220ab None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:00.066989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 419/845] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:00.066989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f537f9-ccf4-4dbc-8c62-c1ca6cc03718 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.066989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f537f9-ccf4-4dbc-8c62-c1ca6cc03718 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.066989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f537f9-ccf4-4dbc-8c62-c1ca6cc03718 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.066989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 420/846] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:00.072406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.072406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.072406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.094853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:00.096206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:00.115651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.140413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 427/847] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:19:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:00.147471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.215328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 421/848] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:00.292858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dd6a6-6750-4748-b57c-6915c6daf3fa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.331052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:00.332669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.333381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.333983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.345654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:00.347452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:00.364465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:00.365499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:00.366451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:00.366451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:00.366451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:00.368644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 428/849] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:00.374812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.431381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.483689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cf0f8-6e87-40a5-a53f-83916422f4e4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.484852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.533167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:00.533791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.534069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.534340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.535031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:00.535393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:00.537237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.538728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:00.555189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 422/850] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:00.561802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.611195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37794-7262-4119-9013-b2937fd157f9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.652718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ea84b-cb3f-4aa6-940a-41ae5e8073cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:00.653301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ea84b-cb3f-4aa6-940a-41ae5e8073cf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.653594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ea84b-cb3f-4aa6-940a-41ae5e8073cf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.653879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ea84b-cb3f-4aa6-940a-41ae5e8073cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.665118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ea84b-cb3f-4aa6-940a-41ae5e8073cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1e7ea84b-cb3f-4aa6-940a-41ae5e8073cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:00.671114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:00.672241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:00.673317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 429/851] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:00.674003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d88ab-6c00-471d-94af-e8cd251213ed None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.674003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d88ab-6c00-471d-94af-e8cd251213ed None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.674235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d88ab-6c00-471d-94af-e8cd251213ed None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.678734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 430/852] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:00.678734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d88ab-6c00-471d-94af-e8cd251213ed None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.696935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d538a1-0a27-4cbf-9def-0984332ee328 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.708667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.735471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:00.736097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.736374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.736645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.744168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:00.745601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-84bea445-90c8-454a-86a8-a97515726870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:00.757497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:00.758573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:00.759512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 423/853] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:00.759996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.760239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.760507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.779337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:00.780523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:00.796317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.801415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d88ab-6c00-471d-94af-e8cd251213ed None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.838719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:00.839320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:00.839597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:00.839864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:00.840524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:00.840821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:00.842186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:00.850602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 431/854] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:00.851360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.857419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 424/855] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:00.858141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:00.961447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:00.964552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3c4f0-5f3e-4cc4-ab9c-633d1eee187d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:00.982314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1200eb-e10d-4ac0-be82-c34216f2e534 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.000293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.000872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.001148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.001468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.013453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.014810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.025713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.026662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.027195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.027670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.028688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:01.029211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:01.030650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:01.031589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:01.032480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:01.032480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:01.032480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:01.033371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.037666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 425/856] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:01.038634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.054881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 432/857] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:01.056253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.080429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:01.147699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c98f2-baf4-4316-8b91-2bfadc86b113 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.173862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323a38-c7c8-4d19-bdd2-30df7c32cbb7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.184478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.185088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.185368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.185648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.186291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:01.186595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.187985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.200204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 426/858] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:01.201049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.217866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:01.220269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.220883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.221166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.221441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.222182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=bf51aca728a64f6ba4c143377a24b345) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:01.222822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.224041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.230587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 433/859] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/role_assignments?user.id=bf51aca728a64f6ba4c143377a24b345&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:01.231665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.338893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da145-3722-49cd-9986-1f75e67945d1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.355002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:01.378361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ab084-1986-43a2-9246-3a0b04b2d942 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.384493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.384493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.384493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.384493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.385176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.387992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:01.400768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:01.401733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:01.402595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:01.403990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 427/860] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:01.411446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.427235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.427872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.428149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.428542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.438441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.439887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:01.452529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:01.453588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:01.454530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 434/861] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:01.461127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.508244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:01.537410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fd430-8d2c-473c-8c10-8e38ef3a50ab None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.584465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de60d-487b-4237-9acd-241934242693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.585635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de60d-487b-4237-9acd-241934242693 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.586504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de60d-487b-4237-9acd-241934242693 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.587117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de60d-487b-4237-9acd-241934242693 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.588007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54de60d-487b-4237-9acd-241934242693 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:01.588710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54de60d-487b-4237-9acd-241934242693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.590981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54de60d-487b-4237-9acd-241934242693 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.592386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0794d-1989-4ae0-abc3-a3eecaaf8b9c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.599215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 428/862] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:01.602369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de60d-487b-4237-9acd-241934242693 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.654803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.656205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.656698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.657537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.658794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:01.659309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.662379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.688373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 435/863] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:01.694779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:01.698668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:01.734198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de60d-487b-4237-9acd-241934242693 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.783476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.784436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.786074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.786560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.787454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:01.788378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.790553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.802745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 429/864] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:01.818319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692aac-4b2b-4147-9794-004c34e2d248 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:01.857335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dbf3f-3913-4123-9f03-f6c9347e2b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:01.858022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dbf3f-3913-4123-9f03-f6c9347e2b66 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:01.858300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dbf3f-3913-4123-9f03-f6c9347e2b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:01.858622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dbf3f-3913-4123-9f03-f6c9347e2b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:01.946831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dbf3f-3913-4123-9f03-f6c9347e2b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:01.948925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dbf3f-3913-4123-9f03-f6c9347e2b66 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:01.951416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.060738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 436/865] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:02.066045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:02.071218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.119296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2123-5f8b-4629-b48d-a9dc63018481 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.119641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2123-5f8b-4629-b48d-a9dc63018481 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.119841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2123-5f8b-4629-b48d-a9dc63018481 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.122382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 437/866] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:02.126392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.126673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.126988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.148176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:02.149799 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:02.181417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ced75e-ca6e-4b32-b29c-b08e6db30b30 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:02.225002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:02.226197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.226630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.227305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.243600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:02.245525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:02.246870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 438/867] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:02.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:02.263316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:02.264224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:02.264224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:02.264224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:02.266335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 430/868] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:02.272832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:02.307904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.375118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4cbe1-97c4-4af1-9fdb-5363b94a9cc3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:02.413928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:02.414555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.414898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.415172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.415832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:02.416189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:02.417579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:02.430809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 439/869] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:02.435899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:02.502957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.521298 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:02.555219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ac95-2feb-4f2e-a5c6-b2f0b447e476 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:02.592131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:02.592754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.593038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.593312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.601383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:02.606810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:02.622729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:02.623887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:02.624903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:02.626951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 431/870] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:02.627397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.632911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:02.640288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467c8b1-42e6-483d-8bc9-3814f35c635d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:02.683240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:02.683954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.684312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.684665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.685398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:02.686902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:02.754112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd2317-b3e9-4f3d-bf56-a4c1517c51b3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:02.771375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 440/871] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:02 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:02.779038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.807597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:02.808524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.809022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.809477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.810392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:02.810907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:02.812661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf2d2c-896b-4ad2-a58b-d5b3ff31a4df None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:02.828013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 432/872] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:02.835468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:02.951460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaefbc9-be4f-40e7-ab74-14337553e85f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:02.989587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:02.990356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:02.990754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:02.991134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:02.991987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=356dc6f47f454900ba6a7b7ee7a481fa) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:02.992394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:02.993928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077dafb-f31e-449f-8ee0-3ba5206197e3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:03.003028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 441/873] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:02 2022] GET /identity/v3/role_assignments?user.id=356dc6f47f454900ba6a7b7ee7a481fa&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:03.387405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13919c66-6ce3-4ede-917a-112a3fbc36e5 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:03.388141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13919c66-6ce3-4ede-917a-112a3fbc36e5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:03.388635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13919c66-6ce3-4ede-917a-112a3fbc36e5 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:03.390502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 433/874] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:03.396410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:03.396893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:03.396970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:03.416441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:03.417648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:03.435102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:03.493996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 442/875] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:03.769137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13919c66-6ce3-4ede-917a-112a3fbc36e5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:03.883919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13919c66-6ce3-4ede-917a-112a3fbc36e5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:03.921846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:03.922489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:03.922796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:03.923071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:03.923662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:03.925102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-af287705-4add-409f-a66f-47d3a58a23d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:03.935597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:03.936629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:03.937467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 434/876] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:03.945545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:03.948072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280d3f-c559-49d1-9e57-c84794adfaf8 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:03.948443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280d3f-c559-49d1-9e57-c84794adfaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:03.948617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280d3f-c559-49d1-9e57-c84794adfaf8 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:03.949955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 435/877] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:03.955463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:03.955744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:03.956075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:03.976203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:03.977404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:04.015050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:04.052156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 436/878] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:04.055925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2838-5bc2-482e-b916-79b8026eb911 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:04.094552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:04.095189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:04.095467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:04.095739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:04.096372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:04.096673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:04.098862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:04.104734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 443/879] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:04.110095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:04.220694 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b2bf7-dfce-4480-a04a-a5e9e49d9c2a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:04.260520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:04.261169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:04.262154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:04.262154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:04.262957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:04.263262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:04.264647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a813e-f687-4103-bc91-503b4acff332 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:04.271008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 437/880] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:04.329973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:04.344365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:04.444984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269c19-e6c6-4add-8547-10600f77e8ea None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:04.481480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b69a-9863-4c38-9f40-dc37f41a6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:04.482437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b69a-9863-4c38-9f40-dc37f41a6a05 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:04.482965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b69a-9863-4c38-9f40-dc37f41a6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:04.483430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b69a-9863-4c38-9f40-dc37f41a6a05 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:04.484283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b69a-9863-4c38-9f40-dc37f41a6a05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:04.485858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b69a-9863-4c38-9f40-dc37f41a6a05 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:04.587471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 444/881] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:04 2022] POST /identity/v3/services => generated 269 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:04.992113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615ef2-8ec2-4688-95c6-7d27b3c808e9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:04.992638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615ef2-8ec2-4688-95c6-7d27b3c808e9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:04.992638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615ef2-8ec2-4688-95c6-7d27b3c808e9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:04.994345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 438/882] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:04.999850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a851edf-425d-40e7-8afa-bcfd6df8cb2f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.000143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a851edf-425d-40e7-8afa-bcfd6df8cb2f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.000420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a851edf-425d-40e7-8afa-bcfd6df8cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.020820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3a851edf-425d-40e7-8afa-bcfd6df8cb2f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:05.022040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3a851edf-425d-40e7-8afa-bcfd6df8cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:05.089569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:05.100839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 445/883] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:05.108160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61058f-2cd6-4537-af5b-242dd042d884 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.108449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61058f-2cd6-4537-af5b-242dd042d884 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.108729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61058f-2cd6-4537-af5b-242dd042d884 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.110242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 439/884] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:05.116079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.116587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.117036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.137241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:05.139250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:05.209553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 446/885] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:05.402306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61058f-2cd6-4537-af5b-242dd042d884 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.435375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:05.500588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.520986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61058f-2cd6-4537-af5b-242dd042d884 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:05.561344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:05.562369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.563106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.563666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.564518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:05.567379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:05.578478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:05.579704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:20:05.580733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:05.583305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 440/886] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:05.589300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.629457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bce31-7160-48c0-9cbf-50bc132f9e5b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:05.674832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:05.687161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:05.688043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.689332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.689332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.704490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:05.710641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:05.712779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:05.713956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:05.714968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:05.722664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 447/887] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:05.724424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.725185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb7ff5-9468-49f3-b5ad-543a6507509b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:05.765506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:05.766440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.766909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.767527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.768142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:05.768607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:05.770726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:05.776902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 441/888] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:05.782557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.866993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d2ea-4a7a-406e-865d-9e622d853336 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:05.893551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e0dcb-b7ce-4551-98ea-4d1fd5ee22d6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:05.916306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:05.917200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.917893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.918318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.919413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:05.920305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:05.922078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:05.932296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:05.932965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:05.933342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:05.933880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:05.934670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:05.935106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:05.940630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:05.940803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 448/889] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:05.943704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.947204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 442/890] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:05.957723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:05.986552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:06.013926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:06.072992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081939c-20a7-4a74-b565-82c0022fe1f0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.083738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615853-9abf-4d69-b176-e3314fceec74 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.114649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.115330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.115623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.115935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.117045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] RBAC: Adding query filter params (interface=public, service_id=9216138a7f63451281badb856e44d11b, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:06.117448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.118948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.127597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 443/891] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/endpoints?service_id=9216138a7f63451281badb856e44d11b&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:06.130255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:06.133875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.134522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.134841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.136016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.150366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.151964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:06.171037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:06.172043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:06.172942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:06.172942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:06.172942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:06.174762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 449/892] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:06.183015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:06.247841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:06.265487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbfda6-2e6e-459d-a71e-745e2aed15a4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.301873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:06.306211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df61e5a-db13-48b9-bfb0-6515dc6e3e61 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.309188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9334b3-5230-4681-bfe6-f3944773bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.309809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9334b3-5230-4681-bfe6-f3944773bff8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.310090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9334b3-5230-4681-bfe6-f3944773bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.310365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9334b3-5230-4681-bfe6-f3944773bff8 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.311008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9334b3-5230-4681-bfe6-f3944773bff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.312368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9334b3-5230-4681-bfe6-f3944773bff8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.318494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 444/893] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:20:06 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:20:06.319806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921e75-966e-4d7e-9057-c374ab40d980 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.320089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921e75-966e-4d7e-9057-c374ab40d980 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.320361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921e75-966e-4d7e-9057-c374ab40d980 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.321820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 445/894] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:06.327621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.328009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.328177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.347992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:06.349503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:06.361701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.363863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.364702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.365173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.366353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:06.367421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.369646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.391293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 450/895] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:06.397328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:06.449313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 446/896] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:06.518267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664ea6c-4baf-451f-a958-da72384c1775 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.557726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.558742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.559279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.559822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.568135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.569952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f53385a0-8891-4343-8e67-00d379579d43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:06.583669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:06.584682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:06.585672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:06.588367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 451/897] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:20:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:06.594257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:06.644294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9588a3-ea44-49a4-8ae1-a8be6582d442 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.644701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9588a3-ea44-49a4-8ae1-a8be6582d442 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.644966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9588a3-ea44-49a4-8ae1-a8be6582d442 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.646465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 452/898] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:06.652732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.653168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.653539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.677928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:06.679728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:06.701566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:06.702995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:06.725089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b9947-ee21-4448-9d34-2afdf63961a5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.764243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.764862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.765143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.765418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.770878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:06.771034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 453/899] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:06.771118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.771192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:06.771290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.791737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 447/900] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 05:20:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:06.797487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:06.903687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cb4a9-75c5-4d63-a742-cbdcf9808bc4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.931902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a755-2d39-4f94-8600-2fd7b9270a3b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:06.955822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.956827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.957537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.958021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.959128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:06.961527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:06.973468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:06.974757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:06.975360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:06.975937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:06.990178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.042757 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 454/901] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:06 2022] POST /identity/v3/services => generated 241 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:07.048621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.063416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.084043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.085572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.203726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f71936-5a72-45ba-bd97-619b1eb40092 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.218655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 448/902] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:06 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:07.225233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.251552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.252443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.252901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.253319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.254740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.256480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:07.270225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:07.271289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:07.272214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 455/903] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:07.278322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.281136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.366796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b0ae-76e3-41f6-87d3-88832dd4d98e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.383914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.404566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.405203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.405478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.405747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.408812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b61a-8c16-4f10-b807-a886935dab0c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.417732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.419247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:07.435055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:07.436104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:07.437015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:07.437015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:07.437015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:07.437015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 449/904] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:07.442502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.464927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.466324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.466853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.467327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.468175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:07.469315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.471251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.482896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 456/905] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:07.484919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.559989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.572593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19f5c-43e9-423a-b0d5-c7a1788c91ef None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.621569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.622462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.623117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.623467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.624208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:07.624583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.625066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435884c-6c59-4631-b3f8-ae1d5dbf2c1b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.626139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.646878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 450/906] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:07.648395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.673931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.675679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.676208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.676684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.677790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:07.678587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.680963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.683356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.690870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 457/907] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:07.696483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.789598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e07135-884f-4546-b8ba-1ea00a482d6f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.827063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.827731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.828010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.828282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.829676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f67-bad1-46d6-a879-c0c84cc90324 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.835777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.837276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:07.849871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:07.850893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:07.851776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:07.856019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 451/908] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:07.856930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.871725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:07.878932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:07.880197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:07.880685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:07.881160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:07.882631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] RBAC: Adding query filter params (interface=public, service_id=f6aa8470d6534377a52ffc7a9693a79d, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:07.883186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:07.885302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:07.902758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 458/909] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/endpoints?service_id=f6aa8470d6534377a52ffc7a9693a79d&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:07.904027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:07.975317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a93e2-1a28-43a6-85ac-c17761ccb9c8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:07.981602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:08.022630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:08.023652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:08.024138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:08.024888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:08.025805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:08.026476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:08.028957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:08.036304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eefe55-71b7-40fd-89dd-3c75c4e4a618 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:08.047387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 452/910] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:08.055214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:08.083321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4c41-8e45-4611-8cf5-7a6862c00b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:08.084269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4c41-8e45-4611-8cf5-7a6862c00b3c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:08.085438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4c41-8e45-4611-8cf5-7a6862c00b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:08.085904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4c41-8e45-4611-8cf5-7a6862c00b3c None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:08.087043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4c41-8e45-4611-8cf5-7a6862c00b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:08.089522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4c41-8e45-4611-8cf5-7a6862c00b3c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:08.106979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 459/911] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:20:07 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:20:08.153378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:08.190237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce19bf-96a3-45f9-9d85-f9ecbc62ebdd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:08.232965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:08.233731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:08.234010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:08.234280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:08.235071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] RBAC: Adding query filter params (role.id=f06679f1c3b945e79146a6a7ea9617e4, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=356dc6f47f454900ba6a7b7ee7a481fa) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:08.238649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:08.238649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332f497-ff36-4517-9180-716897a3b702 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:08.244334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 453/912] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:08 2022] GET /identity/v3/role_assignments?user.id=356dc6f47f454900ba6a7b7ee7a481fa&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=f06679f1c3b945e79146a6a7ea9617e4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:08.410422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb137c6-0d06-491c-b375-6866216ae9d0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:08.411359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb137c6-0d06-491c-b375-6866216ae9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:08.411683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb137c6-0d06-491c-b375-6866216ae9d0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:08.413430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 460/913] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:08.419725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:08.420413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:08.420906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:08.445071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:08.446535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:08.521964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 454/914] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:08.808117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb137c6-0d06-491c-b375-6866216ae9d0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:08.926249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb137c6-0d06-491c-b375-6866216ae9d0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:08.955464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:08.965397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:08.966035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:08.966316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:08.966588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:08.967218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:08.968597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1ec6c2e2-9ea7-45a7-afb7-47decdce6618 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:08.978582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:08.981117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:08.982031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 461/915] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:20:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:08.985918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:09.056094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:09.099598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b18284-3454-4437-a421-5e1db31ce03a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:09.129368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9578-351a-4d02-bd4b-614ea09f7f7c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.130037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9578-351a-4d02-bd4b-614ea09f7f7c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.130530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9578-351a-4d02-bd4b-614ea09f7f7c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.132408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 462/916] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:09.136792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:09.136792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.137132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.137346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.137980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:09.138280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:09.139192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.139649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:09.139920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.140394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.145959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 455/917] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:20:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:09.151808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:09.161123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:09.162735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:09.243172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 463/918] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:09.275280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e7e46-24d7-4b9e-8021-6859885e422d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:09.304283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:09.313270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:09.314126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.314564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.315009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.316367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:09.316884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:09.318546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:09.328696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 456/919] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 05:20:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:09.330267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:09.440478 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59343-85d7-45ab-8b81-b6e66d1820fa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:09.466369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:09.481182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:09.483968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.483968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.483968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.483968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:09.484659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:09.527004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:09.566859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 464/920] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:20:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:09.651396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d2b6-d7f7-4ca4-9336-bb4e8ee9509f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:09.699381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:09.700090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.700372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.700645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.701240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:09.702626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:09.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:09.714521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:09.715649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 457/921] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:09.721346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:09.859639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a40f3-4933-4bf1-9f33-f83a88f0fee0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:09.918375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:09.919997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:09.920766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:09.921508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:09.922920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:09.923759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:09.926561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd460-d453-45d3-8d95-448bd07afb31 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:09.935744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 465/922] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:09.944409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.017302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:10.071681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356a15-14cb-49be-b78d-31ce2ecce568 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:10.099491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7517-c873-4e39-8863-173fc15190be None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.100428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7517-c873-4e39-8863-173fc15190be None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.101201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7517-c873-4e39-8863-173fc15190be None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.103570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 466/923] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:10.108875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.109152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.109426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.113204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:10.114837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.115331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.115819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.116672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:10.117220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:10.118599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:10.124347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 458/924] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:10.129344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:10.131143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:10.131620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.175812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:10.226739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 467/925] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:10.262807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d95e5-fe56-46f8-8065-416056471313 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:10.281395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:10.302000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:10.302972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.303432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.303900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.304857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] RBAC: Adding query filter params (interface=public, service_id=de36a3ad088d42e7a75639ed89b4c55b, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:10.305343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:10.307014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73969ad-06d0-4195-bfad-7cc6756a2090 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:10.318533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 459/926] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/endpoints?service_id=de36a3ad088d42e7a75639ed89b4c55b&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:10.321794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.322447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb0b4-a84f-4d2f-8e0a-37c290060369 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.322764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb0b4-a84f-4d2f-8e0a-37c290060369 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.323039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb0b4-a84f-4d2f-8e0a-37c290060369 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.324603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 460/927] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:10.329941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.330265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.330497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.351544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:10.352763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:10.435069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 461/928] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:10.453358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef7e17-4371-41b7-bd85-ae26f12743fa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:10.490064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:10.490674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.490977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.491250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.491893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:10.493258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:10.499767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 468/929] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:20:10.523672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.637611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d601cf-c21b-4d2b-a041-6c09e75f1e48 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:10.651462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:10.675221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:10.675929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.676210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.676478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.677197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:10.678561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:10.687755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:10.688789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:10.690070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 462/930] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:10.697297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.706345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.758236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:10.843762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356948bd-f580-4735-8f91-e4bf8a083d80 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:10.858282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7f9a9-b212-461f-9b9e-c95530d61636 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:10.887983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:10.889164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.889667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.890446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.898599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:10.899244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:10.899715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:10.900055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:10.900851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:10.901159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:10.902534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:10.906807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:10.907967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 469/931] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:10.913271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:10.914244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:10.915150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 463/932] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:10.916483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.920251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:10.964596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:11.032480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30358222-b48c-49f2-9b0a-350d610827ac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.051560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d545-2641-4ada-81d7-098ebd532c66 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.055113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:11.077212 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.078810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.079526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.079976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.082015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:11.082505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.084614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.090300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.091101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.091450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.091841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.092264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 470/933] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:11.097006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:11.097381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.097977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:11.098899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.113266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 464/934] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:20:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:11.114502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:11.213766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d903-3ab9-43de-af89-8f4f05197ea2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.224700 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:11.231606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ab7b-32fb-4902-96a9-e50f0abde013 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.252218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.252908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.253191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.253490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.254157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.256288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.271414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.272155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.272536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.272877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.284033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.286220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:11.302060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:11.303490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:11.304415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:11.304415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:11.304415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:11.305174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 465/935] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:11.309107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:11.322813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 471/936] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:20:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:11.447105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d551-6ddc-4ca1-b2a0-d909472f2fe1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.492671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.493287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.493563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.493836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.494482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:11.494797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.496284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.512180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 466/937] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:11.518061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:11.540789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:11.644994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba56f-c61f-44b9-9f6d-0c84b31688e6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.682161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.682845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.683130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.683405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.695720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.697242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7d5b8286-b3f6-4ae7-87e6-a02921812195 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:11.709704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:11.710677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:11.711675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 472/938] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:20:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:11.718681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:11.723035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:11.736530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54bef-a3c1-400b-954f-5606ac0d9b50 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.736811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54bef-a3c1-400b-954f-5606ac0d9b50 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.741796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54bef-a3c1-400b-954f-5606ac0d9b50 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.741796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 473/939] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:11.744676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.744963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.745242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.765020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:11.766544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:11.838760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e383b65-d191-497c-890b-6f59ac816c43 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:11.858847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 474/940] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:11.880805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:11.881417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:11.881695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:11.881961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:11.882792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:11.883116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:11.884516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:11.903795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 467/941] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 05:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:11.911810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:11.923989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:12.021109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f4282-c182-4178-b723-84ffcec29697 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.058048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.059063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.059548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.060045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.071067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.072828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:12.088415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:12.089426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:12.090325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:12.090325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:12.090325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.092563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 475/942] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:12.099212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.170314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:12.179337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.219553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd085be-f89f-407f-8ffc-7d72ea0f2ca1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.246849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:12.264562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.264562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.264562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.264562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.265046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:12.265046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.265046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.281648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 468/943] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:12.286039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.313399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2c57-4dce-42b3-bac8-2c3591e45854 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.361555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.362107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.362449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.363519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.364388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.365837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.368611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING keystone.server.flask.common [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 05:20:12.414366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0874d7-892c-4271-94fb-82c8f189af62 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.416751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.sql.core [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:20:12.416751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 05:20:12.416751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [parameters: {'id': '0f868ee50ab84712adda24e80221f8cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 05:20:12.416751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81642) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f868ee50ab84712adda24e80221f8cf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f868ee50ab84712adda24e80221f8cf. Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:20:12.439684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 05:20:12.440605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application yield resource Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise self.value Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application session.commit() Aug 24 05:20:12.442128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:20:12.443779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:20:12.444698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:20:12.445476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [parameters: {'id': '0f868ee50ab84712adda24e80221f8cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.446323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:12.448419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f868ee50ab84712adda24e80221f8cf. Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 476/944] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Aug 24 05:20:12 2022] POST /identity/v3/projects => generated 262 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:12.450598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.457449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:12.466953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.467992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.468467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.468959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.476766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.482133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:12.492606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:12.493580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:12.494512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:12.497143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 469/945] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:12.504573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.587787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccac957-9be1-40c9-b952-430bec86ade6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.610435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:12.629252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.629997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4141-5620-423d-b22e-0dec6db4bb56 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.630108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.630363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.630639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.638130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.639961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1dffc831-d747-48c2-ad33-dbd18a43b3ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:12.652818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:12.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:12.654651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 477/946] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:12.655624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc1ea1-7a09-4dfc-83c6-7ef85eeb5a49 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.655624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc1ea1-7a09-4dfc-83c6-7ef85eeb5a49 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.655797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc1ea1-7a09-4dfc-83c6-7ef85eeb5a49 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.660249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 478/947] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:12.661185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc1ea1-7a09-4dfc-83c6-7ef85eeb5a49 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.672933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.673616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.673973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.674317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.675748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:12.676165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.677756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeadcd1-dbcd-47dc-b053-68349a0795a0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.690280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 470/948] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:12.696541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.696825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.697098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.715157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:12.716336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:12.752965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:12.772853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc1ea1-7a09-4dfc-83c6-7ef85eeb5a49 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.790750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 471/949] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:12.790750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:12.819679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.820287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.820573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.820877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.821807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:12.822110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.824402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:12.846072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 479/950] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:12.922671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd297-809a-4e7a-a492-4d30f38d4872 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:12.965279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:12.966256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:12.966730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:12.967149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/356dc6f47f454900ba6a7b7ee7a481fa/roles/f06679f1c3b945e79146a6a7ea9617e4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:12.969616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=356dc6f47f454900ba6a7b7ee7a481fa, role_id=f06679f1c3b945e79146a6a7ea9617e4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:12.971288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:13.022981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 472/951] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:20:12 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/356dc6f47f454900ba6a7b7ee7a481fa/roles/f06679f1c3b945e79146a6a7ea9617e4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:20:13.069850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:13.119093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:13.200630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77e262-2bc2-4370-ba46-df18ef68639e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:13.247043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:13.247896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:13.248336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:13.248616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:13.249219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:13.250675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8a7e97f7-c8a5-4328-9499-fd189a3d12b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:13.261026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:13.264405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:13.265516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 480/952] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:13.273934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:13.308315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:13.395691 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab3f97-f1cf-4377-b5cb-494647339559 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:13.412828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681921af-5978-443c-b4b5-c20280339073 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:13.413262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681921af-5978-443c-b4b5-c20280339073 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:13.413666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681921af-5978-443c-b4b5-c20280339073 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:13.415530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 481/953] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:13.420796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:13.421084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:13.421432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:13.433615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:13.434518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:13.434973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:13.435383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:13.436167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:13.436610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:13.438232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:13.444362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:13.444817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 473/954] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:13.446220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:13.450280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:13.546802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 482/955] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:13.581318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:13.588260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061fcc2-c48c-436e-9598-df73ea6c1de8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:13.635123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:13.635734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:13.636012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:13.636540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:13.637165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:13.637459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:13.638856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:13.644966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 474/956] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:13.650485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:13.684019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:13.771305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c460-7a9c-407c-8854-67109ba1d822 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:13.810272 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:13.810913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:13.811195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:13.811469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:13.812160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:13.813623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:13.850271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:13.889595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 483/957] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:20:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:13.987166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934635e-d9a3-4101-91e4-f85a97f83585 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:14.036296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:14.037307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:14.037822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:14.038279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:14.039515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:14.040296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:14.049719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:14.051475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:14.052340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 475/958] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:14.057948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:14.159077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:14.173775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525161-4a51-45bd-a40d-f670c5de74c2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:14.213818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:14.214441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:14.214736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:14.215011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:14.215656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:14.215958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:14.217403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f0a0-d13c-49ff-a7e2-b0412fa94350 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:14.223791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 484/959] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:14.229796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:14.254817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:14.354980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80140f3-636e-4da4-bd74-1ffffb4c5a03 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:14.395604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:14.396229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:14.396511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:14.396788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:14.397435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:14.397742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:14.399144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a98fb3-4f74-4b9e-9663-0ef99bad8fe9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:14.410855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 476/960] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:15.082012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4182d6-abbb-4d66-81f1-b9990df670c5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:15.082410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4182d6-abbb-4d66-81f1-b9990df670c5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:15.082603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4182d6-abbb-4d66-81f1-b9990df670c5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:15.084394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 485/961] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:15.091280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:15.091564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:15.091842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:15.111954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:15.113242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:15.203564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da08552-cbd5-4187-86cf-196d4a89ad73 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:15.204088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da08552-cbd5-4187-86cf-196d4a89ad73 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:15.204088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da08552-cbd5-4187-86cf-196d4a89ad73 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:15.205703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 486/962] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:15.211060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:15.211342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:15.211620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:15.231263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:15.232471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:15.232979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 477/963] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:15.305197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 487/964] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:15.576248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:15.594239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:15.685453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:15.737817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bfe5-25a7-4d63-b89a-9c09dd75a159 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:15.785602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:15.790273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:15.791284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:15.791582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:15.791858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:15.807785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:15.810977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594b634-b449-403b-bee2-a2243dd6cd2b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:15.815249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:15.816917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:15.817856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 478/965] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 05:20:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:15.824000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:15.870000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:15.870714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:15.871110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:15.871747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:15.872510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:15.874869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:15.915489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.sql.core [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:20:15.915489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 05:20:15.915489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [parameters: {'user_id': 'f848fec332374297b769ce3e20ab0e94', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 05:20:15.915489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81642) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Aug 24 05:20:15.925184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:20:15.926297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application yield resource Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise self.value Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application session.commit() Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:20:15.927491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:20:15.928836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:20:15.930072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:20:15.936106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f848fec332374297b769ce3e20ab0e94', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:15.938222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 05:20:15.940235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 488/966] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 05:20:15 2022] POST /identity/v3/users => generated 160 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:15.942985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:15.944856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:15.972526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09b58c-3ede-46a7-9d0a-c4277e3c23e1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.012083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.013097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.013679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.013948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.014618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:16.014960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.016378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995cb97-69ec-46bc-9888-7bb823710703 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.031621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 479/967] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:20:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:16.031621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0547ae-a58a-4bc9-9001-7f65d91e85dc None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.031621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0547ae-a58a-4bc9-9001-7f65d91e85dc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.031621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0547ae-a58a-4bc9-9001-7f65d91e85dc None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.031621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 480/968] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:16.035157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0547ae-a58a-4bc9-9001-7f65d91e85dc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.059288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0ab2-1bfe-4f44-8acd-02e0ac303017 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.096496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.097168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.097445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.097713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.105924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.107608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-024a3cee-8f97-4e68-80f3-3adb02279264 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:16.121944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:16.122986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:16.123923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 489/969] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:20:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:16.125128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.125578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.126012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.135165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.148639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:16.154142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:16.165570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0547ae-a58a-4bc9-9001-7f65d91e85dc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.214712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.215599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.215918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.216170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.219732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.230001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.231562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.245437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 490/970] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:16.245437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:16.264176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:16.265809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:16.267182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:16.267182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:16.267182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:16.267182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 481/971] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:16.272078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.399234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff601cc4-3fe4-487f-a4c3-7f2069d359fa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.439990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8363385-f81b-455d-86ce-d43597903b68 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.441036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.441929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.442638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.443148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.444651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:16.445109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.447695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.462749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 482/972] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:16.467624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.481144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.486801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.487619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.487753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.488133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.488917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:16.489225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.490663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.527258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.533576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 491/973] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:16.534574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.619541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3676-18c9-4c2e-a7f1-b2d93a039560 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.674415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.675483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.675884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.676560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.685053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d810f6-2155-45f0-bbac-d7f7545dd779 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.687441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.692628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-861228e8-60da-452a-9a03-b0149c616282 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:16.710627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:16.711703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 483/974] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:16.713352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a726-3d3e-42be-bee8-8787326e8557 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.714029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a726-3d3e-42be-bee8-8787326e8557 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.714029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a726-3d3e-42be-bee8-8787326e8557 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.715821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 484/975] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:16.719309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5a726-3d3e-42be-bee8-8787326e8557 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.729704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.730347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.730640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.730950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.731668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.733040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-84ac9017-f5ae-4ef3-86ee-dfde672b66a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:16.743555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:16.744601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:16.745439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 492/976] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:16.746232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.746232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.746524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.766830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:16.767750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:16.832882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.851698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 493/977] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:16.852563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.865568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5a726-3d3e-42be-bee8-8787326e8557 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:16.877224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.911664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:16.912285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:16.912568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:16.912845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:16.913595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:16.913906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:16.915380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:16.939127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 485/978] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:16.944957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:16.976222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65de2b-f6f3-43b1-bb13-291146eab6cd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.018326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.019733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.020210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.020554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.021247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:17.021550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.022979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.028697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 494/979] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:17.035715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:17.092785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ced3a1-8686-45a8-b1c5-30a266880801 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.097429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:17.133458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.134131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.134411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.134786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.154746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7e05-43ea-496e-bf65-f0d32b3fdcf1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.170939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:17.192303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.192806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.193088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.193359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.193999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:17.194301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.195710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.200748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 495/980] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:17.201552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:17.209232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.210712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.314002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012437f6-2ad1-43ef-96ca-b038c95199fa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.317858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 486/981] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:16 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:20:17.318746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:17.332162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:17.357420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.358151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.358429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.358947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.359386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.360767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.385753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:17.421352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee11db-7048-4101-86ad-8873742be692 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.428788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 496/982] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:17 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:17.434502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:17.484206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.485012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.485288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.485555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.486313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] RBAC: Adding query filter params (interface=admin, service_id=de36a3ad088d42e7a75639ed89b4c55b, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:17.486620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.488845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.495530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 487/983] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Aug 24 05:20:17 2022] GET /identity/v3/endpoints?service_id=de36a3ad088d42e7a75639ed89b4c55b&interface=admin®ion_id=RegionOne => generated 193 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:17.502091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:17.578471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af590f-34ea-4570-afd6-4596bd519753 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.631576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.631847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.632044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.632312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.646308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776db0-bcbb-4166-80c1-3c5f38b62c96 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.647067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.648597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:17.667345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:17.668480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:17.669487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:17.669487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:17.669487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:17.669657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 497/984] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:17.676475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:17.682779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:17.694724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.695370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.695655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.695924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.696533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.697895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.704886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 488/985] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:20:17 2022] GET /identity/v3/services => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:20:17.718349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:17.824197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87fb73-3fe0-4c73-8d6b-5d829e9db86e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:17.876719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:17.877336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:17.877618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:17.878492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:17.879398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:17.879703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:17.881111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:17.895858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 498/986] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:17.901078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:18.026315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff7e-6d2a-4cef-a0de-5e744926f71a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:18.071198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:18.071846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:18.072129 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:18.072398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:18.080892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:18.083060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:18.097248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:18.103304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:18.104225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 489/987] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:18.107777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:18.203896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:18.223571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1ceb-1d5b-424e-8a6e-f98e76ab638d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:18.263475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:18.264070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:18.264341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:18.264608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:18.265307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:18.265605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:18.267119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d580e36-9bec-41ea-b137-8bc3936ead7b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:18.286678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 499/988] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:18.288307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:18.342823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:18.399382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2ab4b-6d98-4f1b-96a7-3ad3146ea6c8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:18.438475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:18.439126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:18.439417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:18.439693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:18.441046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] RBAC: Adding query filter params (role.id=f06679f1c3b945e79146a6a7ea9617e4, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=356dc6f47f454900ba6a7b7ee7a481fa) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:18.442212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:18.443531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d89d50-e590-4bab-9e9e-58b46f217e22 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:18.454780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 490/989] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:18 2022] GET /identity/v3/role_assignments?user.id=356dc6f47f454900ba6a7b7ee7a481fa&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=f06679f1c3b945e79146a6a7ea9617e4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:19.413313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4385fa-328a-4604-80be-11a6a1ae8cc2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:19.413882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4385fa-328a-4604-80be-11a6a1ae8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:19.413882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4385fa-328a-4604-80be-11a6a1ae8cc2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:19.415263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 500/990] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:19.421400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1534a7-0002-4fbc-b3b3-c7645bb0c654 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:19.421869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1534a7-0002-4fbc-b3b3-c7645bb0c654 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:19.422282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1534a7-0002-4fbc-b3b3-c7645bb0c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:19.444755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-af1534a7-0002-4fbc-b3b3-c7645bb0c654 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:19.446006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-af1534a7-0002-4fbc-b3b3-c7645bb0c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:19.524812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 491/991] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:19.682626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae0bb2-3840-4b07-a743-6845a2116a5c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:19.682965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae0bb2-3840-4b07-a743-6845a2116a5c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:19.683117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae0bb2-3840-4b07-a743-6845a2116a5c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:19.684627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 501/992] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:19.689765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:19.690052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:19.690916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:19.709935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:19.711168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:19.751861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:19.779512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 492/993] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:19.792895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae0bb2-3840-4b07-a743-6845a2116a5c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:19.908285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae0bb2-3840-4b07-a743-6845a2116a5c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:19.943903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:19.944448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:19.944745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:19.944990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:19.945568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:19.946950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:19.955622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:19.957216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:19.958072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:19.962264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 502/994] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:19.963123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.050819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.063755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:20.079388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a18bf6-832f-402b-ad0b-bf55148d8866 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.121548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.122171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.122450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.122742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.123397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:20.123676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.125036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.130378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 493/995] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:20.136396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.178210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1222-f17c-4afc-92fb-7dc4baccae1e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.184952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:20.226916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.227557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.227996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.228178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.228678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.230049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:20.239190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:20.249348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:20.250285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 503/996] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 05:20:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:20.251174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.272294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1015f7-0cfb-4e3f-be66-557467ce7ae7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.322741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.323828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.324228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.324506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.325142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:20.325442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.326822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.332634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 494/997] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:20.338616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.342451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:20.377130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392a4f-d229-4c91-afe7-9573b07cd502 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.420621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.421278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.421503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.421773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.422416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:20.422829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.424111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.430510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 504/998] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:20.436168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.465737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653796d-b1bd-4378-bfae-9417da4965e4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.467452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:20.512601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.513124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.513399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.513725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.514549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] RBAC: Adding query filter params (interface=public, service_id=18888f4f7e2b40819913dec5d721cc4b, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:20.514988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.516353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.527032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 495/999] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:20:20 2022] GET /identity/v3/endpoints?service_id=18888f4f7e2b40819913dec5d721cc4b&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:20.528735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.552061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b24a2-a34f-4023-be33-a20197af4b20 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.588344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.588958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.589241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.589517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.590160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:20.590465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.591880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4cb65-f8f8-499a-a467-c31d3941f4c0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.594002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:20.597780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 505/1000] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 05:20:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:20.599361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4542dae-d961-4822-aa5d-3675a40975c6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.599650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4542dae-d961-4822-aa5d-3675a40975c6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.599926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4542dae-d961-4822-aa5d-3675a40975c6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.601552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 506/1001] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:20.603675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4542dae-d961-4822-aa5d-3675a40975c6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:20.638975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9aac97-cea5-4601-9f53-8fc96e869bac None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.673478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dde65-9adc-4891-a488-8997b61bcd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.674077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dde65-9adc-4891-a488-8997b61bcd5f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.674353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dde65-9adc-4891-a488-8997b61bcd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.675197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dde65-9adc-4891-a488-8997b61bcd5f None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.675959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dde65-9adc-4891-a488-8997b61bcd5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.677312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dde65-9adc-4891-a488-8997b61bcd5f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.683657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 496/1002] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:20:20 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:20:20.684862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.685144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.685411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.716251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:20.716871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4542dae-d961-4822-aa5d-3675a40975c6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:20.717669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:20.747540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:20.778535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:20.779433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:20.779874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:20.780372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:20.781404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:20.783709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:20.801443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 497/1003] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:20.863970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 507/1004] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:20:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:20:21.073478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:21.187612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42be01-7071-4494-bd96-0d8ac9225ea8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:21.236911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:21.237875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:21.238796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:21.239085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] PATH_INFO: `/v3/services/image` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:21.239684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:21.241204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:21.251738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:21.324880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:21.325932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 498/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 24 05:20:21 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:21.326943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:21.341643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:21.388022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2ad9-d00d-4ebc-90b1-ba711f098cbd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:21.435632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:21.436310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:21.436560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:21.436825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:21.437423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] RBAC: Adding query filter params (name=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:21.437726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:21.439172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a413fd1-9d10-4e9c-a1a3-c38af69cbb6a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:21.451201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 508/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:21.453129 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:21.481836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:21.577593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6fee1-7372-448a-a7ce-365952841f89 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:21.629355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:21.629977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:21.630261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:21.630533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:21.631200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] RBAC: Adding query filter params (type=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:21.631501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:21.632855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bfce-4bfc-4036-a1ba-ffeefca09ffa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:21.638080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 499/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:22.649816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0331f66-6114-4dff-8bd4-61cb275c1768 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:22.650343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0331f66-6114-4dff-8bd4-61cb275c1768 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:22.650343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0331f66-6114-4dff-8bd4-61cb275c1768 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:22.651763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 509/1008] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:22.657105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bf40-3fd8-410d-8214-9fd51a3467fc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:22.657569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bf40-3fd8-410d-8214-9fd51a3467fc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:22.657647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bf40-3fd8-410d-8214-9fd51a3467fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:22.677234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8c66bf40-3fd8-410d-8214-9fd51a3467fc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:22.678476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8c66bf40-3fd8-410d-8214-9fd51a3467fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:22.758634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 500/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:22.819558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31ca13-2f49-42da-b651-5f8f98af71b0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:22.819891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31ca13-2f49-42da-b651-5f8f98af71b0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:22.820108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31ca13-2f49-42da-b651-5f8f98af71b0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:22.821677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 510/1010] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:22.827417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:22.827719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:22.827966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:22.849234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:22.850354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:22.862771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:22.922995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 501/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:23.062198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31ca13-2f49-42da-b651-5f8f98af71b0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:23.173632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31ca13-2f49-42da-b651-5f8f98af71b0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:23.192486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:23.202520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:23.224487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:23.225250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.225534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.225807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.226430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:23.228006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:23.238949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:23.245244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:23.246223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 511/1012] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:23.247224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:23.346228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4aa8c-b420-4dee-a7a6-a8c5bf7f8ee2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:23.363491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab841-3330-44d2-bdff-47bdb98140a6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:23.384888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:23.385627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.386278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.386531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.387727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:23.389175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:23.390815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 502/1013] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:23.396717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:23.406520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:23.407162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.407439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.407705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.408349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:23.408654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:23.410852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:23.414347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:23.416987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 512/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:23.422815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:23.486591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:23.514466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0f7f-7072-4274-b96c-105defa81d4f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:23.554684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1dfc8-c55f-4f81-b83a-fb1ca264df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:23.555606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1dfc8-c55f-4f81-b83a-fb1ca264df3f None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.556050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1dfc8-c55f-4f81-b83a-fb1ca264df3f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.556325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1dfc8-c55f-4f81-b83a-fb1ca264df3f None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.556489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4482a-c264-4c2f-935f-087a0ce5c0c7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:23.556987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1dfc8-c55f-4f81-b83a-fb1ca264df3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:23.558579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1dfc8-c55f-4f81-b83a-fb1ca264df3f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:23.600233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:23.600839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.601116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.601383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.602019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:23.602322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:23.603728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b948d63-f8fa-4894-9f54-9df4edc4f058 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:23.608584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 513/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 05:20:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:23.609813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21521ec-4d10-4f4b-89ab-3b45c07b3538 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.610098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21521ec-4d10-4f4b-89ab-3b45c07b3538 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.610370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21521ec-4d10-4f4b-89ab-3b45c07b3538 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.611584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 514/1016] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:23.614435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21521ec-4d10-4f4b-89ab-3b45c07b3538 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:23.646583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 503/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:23 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:20:23.647822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.648110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.648384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.670352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:23.672374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:23.744213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:23.745216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21521ec-4d10-4f4b-89ab-3b45c07b3538 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:23.762730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 504/1018] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:23.764939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:23.788835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d9cbf-e524-4240-acd3-fdcf8006793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:23.789504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d9cbf-e524-4240-acd3-fdcf8006793f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:23.789779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d9cbf-e524-4240-acd3-fdcf8006793f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:23.790052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d9cbf-e524-4240-acd3-fdcf8006793f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:23.790814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d9cbf-e524-4240-acd3-fdcf8006793f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:23.792246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d9cbf-e524-4240-acd3-fdcf8006793f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:23.857678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 515/1019] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:20:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:24.035135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:24.146100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0894526-3cdd-46c6-ad7b-c3b6cc526b7f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:24.188866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57259f4-7946-4bb4-a640-48e0b1ebee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:24.189491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57259f4-7946-4bb4-a640-48e0b1ebee4c None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:24.189774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57259f4-7946-4bb4-a640-48e0b1ebee4c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:24.190587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57259f4-7946-4bb4-a640-48e0b1ebee4c None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:24.191894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57259f4-7946-4bb4-a640-48e0b1ebee4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:24.193266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57259f4-7946-4bb4-a640-48e0b1ebee4c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:24.275259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 505/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:24 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:20:25.644432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68937c-7735-48e1-9f48-7a9a7bb60cf3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:25.644946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68937c-7735-48e1-9f48-7a9a7bb60cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:25.644946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68937c-7735-48e1-9f48-7a9a7bb60cf3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:25.646461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 516/1021] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:25.651498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e51b2-ed28-428a-9bcf-cede52a7a9be None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:25.651904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e51b2-ed28-428a-9bcf-cede52a7a9be None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:25.652064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e51b2-ed28-428a-9bcf-cede52a7a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:25.670982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-205e51b2-ed28-428a-9bcf-cede52a7a9be None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:25.672160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-205e51b2-ed28-428a-9bcf-cede52a7a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:25.720947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:25.752006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 506/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:25.938826 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463a63-adee-464e-b797-5eaf7a6ed08f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:25.939196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463a63-adee-464e-b797-5eaf7a6ed08f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:25.939529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463a63-adee-464e-b797-5eaf7a6ed08f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:25.942075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 517/1023] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:25.949863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:25.950225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:25.950616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:25.981281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:25.982508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:26.040157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463a63-adee-464e-b797-5eaf7a6ed08f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.056387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 507/1024] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:26.152362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463a63-adee-464e-b797-5eaf7a6ed08f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.187966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfbd38-e1e6-49bd-93ef-392c1b6eb476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.188603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfbd38-e1e6-49bd-93ef-392c1b6eb476 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.188935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfbd38-e1e6-49bd-93ef-392c1b6eb476 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.189156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfbd38-e1e6-49bd-93ef-392c1b6eb476 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.190322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfbd38-e1e6-49bd-93ef-392c1b6eb476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:26.191852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfbd38-e1e6-49bd-93ef-392c1b6eb476 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:26.194729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 518/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:26.199248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.234673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4cb5-3d9e-4d6e-ad61-e302454a314f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.235440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4cb5-3d9e-4d6e-ad61-e302454a314f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.235944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4cb5-3d9e-4d6e-ad61-e302454a314f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.238800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 519/1026] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:26.245223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.245748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.246174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.267489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:26.269754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:26.311838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.328192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477f49d-eabd-475b-a9e1-b72b29e6fb21 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.337623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.350369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 520/1027] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:26.351124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.373323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.373955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.374243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.374513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.375313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:26.376800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:26.462187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb494b26-6211-4081-bb1a-38c29083fbba None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.496650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 508/1028] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:20:26 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:26.502097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.503475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.503960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.504435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.521169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:26.526629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:26.527739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:26.531791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 521/1029] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:26.534429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.628007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.663772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.667135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93565a-5c97-4ffd-8f1a-508fec65d9bb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.707106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.707723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.708007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.708273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.708939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:26.709243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:26.712037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:26.721482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 509/1030] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:26.726320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.743845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89484bae-5386-421d-8f52-d2e4efad298e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.757883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.784057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.784700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.784981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.785252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] PATH_INFO: `/v3/services/image` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.785853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:26.787300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:26.796578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:26.797671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:26.798556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 522/1031] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:26.804406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.846976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251b86-8ff7-4603-957a-a06ea87b0106 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.884219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.884857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.885130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.885400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.896806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:26.898248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:26.909431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:26.914068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:26.915105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:26.916165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:26.916165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:26.916165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:26.916165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 510/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:26.919075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1969cd9-7d1d-4062-8dd1-d3d2f2598270 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:26.921291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:26.957779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:26.958391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:26.958665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:26.958964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:26.959603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] RBAC: Adding query filter params (name=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:26.959909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:26.961285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:26.966763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 523/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:26.973242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.007935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.032195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17621ca-e8a4-4a06-9a27-6e04b6814e06 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.073038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.073661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.073941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.074222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.075063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:27.075396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.076794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.089400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6a485-071e-4b19-94e3-30412950d498 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.090306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 511/1034] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:27.096861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.132507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.133121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.133396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.133666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.134310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] RBAC: Adding query filter params (type=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:27.134609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.136274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.141631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 524/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:27.147917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.176325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.214241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88dca5-430c-4cc4-b05a-ca4ba5b3b40c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.251510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.252248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.252535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.252805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.256039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.261874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.262585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e5739-c069-4d90-b1e9-cbc0ea1bec0b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.263432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:27.276414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:27.277539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:27.278533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 512/1036] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:20:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:27.284192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.305430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.306040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.306316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.306587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.307332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] RBAC: Adding query filter params (interface=public, service_id=c92de733f5b64d5fa17de71f7425cf46, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:27.307645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.309028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.314753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 525/1037] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:20:27 2022] GET /identity/v3/endpoints?service_id=c92de733f5b64d5fa17de71f7425cf46&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:27.320260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.399046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e95fe-aec7-4985-87a9-3224543ffde7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.430860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.436395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.442653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.442653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.442653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.442653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:27.442653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.442653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.446376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b60f6-0fb3-4544-9805-7f6f42784691 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.459617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 513/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:20:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:27.465582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.485760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.486790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.487294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.487710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.488491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.490188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.499929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 526/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:20:27 2022] GET /identity/v3/services => generated 1957 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:20:27.542075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.594841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2453-d289-45d1-96b1-d8376bdb2ab8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.637660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.638292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.638569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.638870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.717628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.719106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.776025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.828522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 514/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:27.829630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:27.933953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f3822-a583-4298-8889-f41cf726f9df None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:27.968532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:27.969170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:27.969446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:27.969713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:27.981312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:27.982789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:27.997680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:27.998680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:27.999630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:27.999630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:27.999630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:28.003819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 527/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:28.004821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:28.107674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed67ab-ba4d-4bb5-bd3a-db73236d79d4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:28.142511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:28.143689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:28.143965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:28.144237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:28.144869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:28.145167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:28.146644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:28.163611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 515/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:28.165270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:28.171040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:28.288006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8981b4b-ae36-46e2-a28d-3bc5d188e2b0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:28.322710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:28.323577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:28.323961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:28.324335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:28.331860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:28.333424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e4ed021b-c740-4b3f-a91f-379f46880038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:28.345065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:28.346244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:28.347424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:28.349078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 528/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:28.354687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:28.375544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:28.464382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d428fc7-cd7a-4b88-b608-2c32635cdba5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:28.499310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:28.500100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:28.500482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:28.500857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:28.501654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:28.502062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:28.504454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:28.520888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 516/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:28.523780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b3524-d5f2-4095-9bd1-291c201016cb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:28.524214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b3524-d5f2-4095-9bd1-291c201016cb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:28.524518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:28.524677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b3524-d5f2-4095-9bd1-291c201016cb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:28.526948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 529/1045] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:28.535845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:28.536135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:28.536413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:28.555612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:28.556867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:28.620929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:28.630513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:28.640695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 530/1046] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:28.647678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900197bd-e2cc-4277-b386-72538170e89b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:28.685616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:28.686223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:28.686502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:28.686801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:28.687529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] RBAC: Adding query filter params (role.id=f06679f1c3b945e79146a6a7ea9617e4, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=5704b06613b94c92896a39fc2b24c280) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:28.687836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:28.689248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:28.703022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 517/1047] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:28 2022] GET /identity/v3/role_assignments?user.id=5704b06613b94c92896a39fc2b24c280&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=f06679f1c3b945e79146a6a7ea9617e4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:28.912096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.016588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5d058-233d-4b6f-87b4-e340b3fd16ed None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:29.053925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:29.054574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.054885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.055161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.066403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:29.071133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:29.072256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:29.073361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:29.074887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 531/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:29.078468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.186786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ac6cf-4a8f-41ea-8a23-5e5468b4f7f8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:29.221781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:29.222397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.222671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.222967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.223637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:29.223938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:29.225292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:29.230905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:29.240078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 518/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:29.241232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.299211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:29.348617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3a86-0c51-4894-a22d-0dc23020bbb3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:29.384720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5810e36-93bd-4048-8629-d094f952cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:29.385358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810e36-93bd-4048-8629-d094f952cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.385636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810e36-93bd-4048-8629-d094f952cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.386167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810e36-93bd-4048-8629-d094f952cc95 None admin] PATH_INFO: `/v3/users/8dc1d9dd28a345c2b5f4e52ec979cc12` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.404049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810e36-93bd-4048-8629-d094f952cc95 None admin] RBAC: Authorizing `identity:get_user(user_id=8dc1d9dd28a345c2b5f4e52ec979cc12)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:29.405550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810e36-93bd-4048-8629-d094f952cc95 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:29.410822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 532/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:29 2022] GET /identity/v3/users/8dc1d9dd28a345c2b5f4e52ec979cc12 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:29.414456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.451336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cb023-3c37-4dea-a66d-244c99a70ccf None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.451619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cb023-3c37-4dea-a66d-244c99a70ccf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.451806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cb023-3c37-4dea-a66d-244c99a70ccf None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.453250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 533/1051] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:29.458463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.458770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.459043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.478303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:29.479517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:29.557853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 534/1052] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:29.559301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c5e97-7ad9-4ded-9642-5caf53c71630 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:29.596466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:29.597461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.597935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.598420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.680811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:29.683123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:29.684570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:29.789807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 519/1053] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:29.795889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.830878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.843199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:29.909039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bd3f-e76b-4cc3-85fd-3cde56709263 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:29.939079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:29.943412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7849-04d9-4b6f-a1ff-3faac0c68ba0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:29.947281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:29.947921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.948201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.951892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.951892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] RBAC: Authorizing `identity:get_project(project_id=3583ead0bf144acb8d2fda9f7c2ffa58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:29.951892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:29.952957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 535/1054] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:29 2022] GET /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:29.959775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:29.984059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:29.984696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:29.984973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:29.985240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] PATH_INFO: `/v3/services/image` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:29.985825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:29.987433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:29.998205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:30.005150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:30.006009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 520/1055] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 24 05:20:29 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:30.006852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:30.066812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf69f-de15-4f42-9824-4806ac1d51ee None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:30.076715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:30.105928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:30.106832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:30.107257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:30.107692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:30.108731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58, user.id=8dc1d9dd28a345c2b5f4e52ec979cc12) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:30.109037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:30.110685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:30.126737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 536/1056] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:29 2022] GET /identity/v3/role_assignments?user.id=8dc1d9dd28a345c2b5f4e52ec979cc12&scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:30.139917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee0e2-4085-4f14-ac79-2188d78c157e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:30.179105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ad555-a069-47af-b585-423140134f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:30.179735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad555-a069-47af-b585-423140134f82 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:30.180012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad555-a069-47af-b585-423140134f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:30.180291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad555-a069-47af-b585-423140134f82 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:30.180936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ad555-a069-47af-b585-423140134f82 None admin] RBAC: Adding query filter params (name=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:30.181237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ad555-a069-47af-b585-423140134f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:30.182672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ad555-a069-47af-b585-423140134f82 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:30.188553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 521/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:30.194842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:30.309017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e192c74-2b0d-4255-bef6-5fb6f745c074 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:30.345290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:30.345860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:30.346141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:30.346422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:30.347098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] RBAC: Adding query filter params (type=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:30.347398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:30.348776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914df63-6f78-4465-a70b-7ae58f8f3e39 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:30.354051 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 537/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:30.359518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ad555-a069-47af-b585-423140134f82 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:30.391099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:30.474319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ad555-a069-47af-b585-423140134f82 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:30.511533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd27465-66c1-4ca9-ad07-bea19f8df1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:30.512145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27465-66c1-4ca9-ad07-bea19f8df1f3 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:30.512423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27465-66c1-4ca9-ad07-bea19f8df1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:30.512694 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27465-66c1-4ca9-ad07-bea19f8df1f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:30.513364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd27465-66c1-4ca9-ad07-bea19f8df1f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:30.514747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd27465-66c1-4ca9-ad07-bea19f8df1f3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:30.590584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 522/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:20:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:30.635827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f870862-215a-43c1-bfe8-2972d2d37676 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:30.636405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f870862-215a-43c1-bfe8-2972d2d37676 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:30.636645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f870862-215a-43c1-bfe8-2972d2d37676 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:30.638217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 538/1060] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:30.644120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:30.644738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:30.645244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:30.666909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:30.668607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:30.755178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 523/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:31.028261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f870862-215a-43c1-bfe8-2972d2d37676 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:31.067500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:31.136819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f870862-215a-43c1-bfe8-2972d2d37676 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:31.174560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:31.175285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:31.175562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:31.175831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:31.186393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:31.191192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:31.192171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:31.193031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:31.195031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 539/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 05:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:31.198335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:31.211650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:31.305912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7b4a8-dd9f-4b5b-8f6f-3c2b329ffbb7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:31.340970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:31.341639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:31.341917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:31.342184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:31.342876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:31.343185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:31.344527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:31.357196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 524/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:31.358810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:31.456043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:31.462436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b885c-3927-4f36-9005-cf456bcc8f46 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:31.497318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:31.497956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:31.498237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:31.498510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:31.511176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:31.512698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:31.529788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:31.530843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:31.531747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:31.531747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:31.531747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:31.534764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 540/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:31.537116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:31.618432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:31.654046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c43a-74c6-4164-9cae-30c37a90d9d6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:31.689299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:31.690749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:31.691040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:31.691314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:31.691967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:31.692272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:31.693637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:31.711742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 525/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:31.713231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:31.825223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca972d-c5d5-4a59-989d-4932449d53cb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:31.860396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:31.860945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:31.861812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:31.862217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:31.869946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:31.871438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:31.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:31.884462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:31.892357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 541/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:20:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:31.893616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:31.996938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaea2-7d3f-49f1-b2a8-49055a0598d1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:32.029118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:32.035219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:32.035849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.036133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.036408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.037154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:32.037461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:32.038930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ba99-2341-4422-985e-083e4f7c34c8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:32.069605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 526/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:20:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:32.072474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:32.084990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:32.090379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254912f0-0375-4b77-b96f-9cb0145a7608 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.090721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254912f0-0375-4b77-b96f-9cb0145a7608 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.090989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254912f0-0375-4b77-b96f-9cb0145a7608 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.092330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 527/1068] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:32.098207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.098572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.098821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.117557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:32.118675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:32.183545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71c3e-4e30-4e77-a1de-23f6ceb1f745 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:32.193061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 528/1069] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:32.218459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:32.219117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.219391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.219656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.231552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:32.233042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:32.248927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:32.249987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:32.256198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:32.256198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:32.256198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:32.256198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 542/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:32.256433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:32.380581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b97e3-4bcf-430d-b0fe-87703e92048b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:32.417193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:32.443329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:32.444259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.444697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.445203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.446413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:32.446951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:32.448911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:32.465821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 529/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:32.473322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:32.486955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:32.554418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:32.610315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266e15f-9444-49c7-9ff3-b75c3729180d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:32.636640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc683cd-9e82-4cd4-834b-992da6ed4fe3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:32.671149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:32.672145 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.672435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.677787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.685348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:32.687435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:32.688474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:32.689656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.690297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.690891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-99503e21-beda-49e2-b1cd-ec063e907702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:32.705802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:32.707109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 543/1072] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e2b0-a14a-4fdc-b5d3-ca60fdfbe2da None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.709270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e2b0-a14a-4fdc-b5d3-ca60fdfbe2da None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.713540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e2b0-a14a-4fdc-b5d3-ca60fdfbe2da None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.713774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:32.714041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 544/1073] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:32.720086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.720505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.721538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:32.722137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:32.723460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:32.724812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 530/1074] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:20:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:32.725891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:32.750179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:32.751843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:32.801956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:32.850951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 545/1075] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:32.851843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:32.879190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d1471-d409-46ce-b891-dd874f85e9fb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:32.922585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:32.923443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:32.923734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:32.924647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:32.925558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:32.925674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:32.925897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:32.927515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:32.941379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 531/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:32.950347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.007321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12981-2d93-4c8b-9e83-f0d6f1218bcb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.049380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313d014-3678-4e66-840a-265526693481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.050328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313d014-3678-4e66-840a-265526693481 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.050875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313d014-3678-4e66-840a-265526693481 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.051321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313d014-3678-4e66-840a-265526693481 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.052021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313d014-3678-4e66-840a-265526693481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:33.052423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313d014-3678-4e66-840a-265526693481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.054684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313d014-3678-4e66-840a-265526693481 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.066762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 546/1077] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:20:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:33.073160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313d014-3678-4e66-840a-265526693481 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.087341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:33.092346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32113dc5-d5e9-4229-a5a1-4e6769925c0f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.145200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.145880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.146157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.146433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/5704b06613b94c92896a39fc2b24c280/roles/f06679f1c3b945e79146a6a7ea9617e4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.148692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=5704b06613b94c92896a39fc2b24c280, role_id=f06679f1c3b945e79146a6a7ea9617e4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.150119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.230835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313d014-3678-4e66-840a-265526693481 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.245166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:33.246909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 532/1078] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:20:32 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/5704b06613b94c92896a39fc2b24c280/roles/f06679f1c3b945e79146a6a7ea9617e4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:20:33.247766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.289917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.290647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.290968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.291269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] PATH_INFO: `/v3/users/8dc1d9dd28a345c2b5f4e52ec979cc12` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.292541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] RBAC: Authorizing `identity:get_user(user_id=8dc1d9dd28a345c2b5f4e52ec979cc12)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.294058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.295810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 547/1079] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:33 2022] GET /identity/v3/users/8dc1d9dd28a345c2b5f4e52ec979cc12 => generated 285 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:33.303675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.393285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f5f2f-001e-4a0c-b857-3c359e3597c3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.440588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.441222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.442788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.442788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.473056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a28888-806e-4633-b1cc-3da58896ab5b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.479094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:33.528615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.529476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.529942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.530381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.532076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] RBAC: Authorizing `identity:get_project(project_id=3583ead0bf144acb8d2fda9f7c2ffa58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.534658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.542367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.542752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 548/1080] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:33 2022] GET /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58 => generated 311 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:33.543899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.545079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.612834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:33.653552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 533/1081] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:33.660260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.668786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988540e2-f807-41ec-b5c8-7f458e2a41ba None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.710004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.710674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.710981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.711260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58/users/8dc1d9dd28a345c2b5f4e52ec979cc12/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.713217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] RBAC: Authorizing `identity:create_grant(project_id=3583ead0bf144acb8d2fda9f7c2ffa58, user_id=8dc1d9dd28a345c2b5f4e52ec979cc12, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.714652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.724329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:33.765778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a3ff-dc03-4921-a647-49fe29d239e6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.788158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 549/1082] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:20:33 2022] PUT /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58/users/8dc1d9dd28a345c2b5f4e52ec979cc12/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:20:33.817408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:33.818086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:33.818366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:33.818655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:33.831720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:33.833200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9e4c5747-92b4-4583-b954-9a3f2dce71ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:33.850507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:33.851662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:33.857712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:33.857712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:33.857712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:33.857712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 534/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:33.859275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:33.980191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71dac-48cb-491d-8f10-47c1687ef182 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:33.990195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:34.017155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:34.018977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:34.019264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:34.019536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:34.020196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:34.020502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:34.021889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e2f22-d09e-4f76-8a6d-5efc509769b5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:34.034733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 550/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:35.233409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8503-2027-44f3-97f0-5dfa00617a86 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:35.233954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8503-2027-44f3-97f0-5dfa00617a86 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:35.233954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8503-2027-44f3-97f0-5dfa00617a86 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:35.235335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 535/1085] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:35.240937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbaf24-03f2-4db6-8f4b-f8d6e8a99123 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:35.250807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbaf24-03f2-4db6-8f4b-f8d6e8a99123 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:35.250807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbaf24-03f2-4db6-8f4b-f8d6e8a99123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:35.260327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fabbaf24-03f2-4db6-8f4b-f8d6e8a99123 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:35.261776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fabbaf24-03f2-4db6-8f4b-f8d6e8a99123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:35.344251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 551/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:35.618183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8503-2027-44f3-97f0-5dfa00617a86 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:35.736282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8503-2027-44f3-97f0-5dfa00617a86 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:35.754982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a9c4a-1a4c-4ed5-bb8b-f96f75d600ac None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:35.755266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a9c4a-1a4c-4ed5-bb8b-f96f75d600ac None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:35.755538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a9c4a-1a4c-4ed5-bb8b-f96f75d600ac None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:35.756462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:35.757013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 552/1087] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:20:35.764032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:35.764315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:35.764586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:35.784328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:35.784962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:35.785246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:35.785520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:35.785630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:35.786794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:35.796015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:35.801235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:35.802260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:35.803166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 536/1088] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 05:20:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:35.808607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:35.860125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 553/1089] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:35.907515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df2979-4038-4479-b08f-5e9d75f5bb08 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:35.941303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:35.941915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:35.942196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:35.942466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:35.943167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:35.943524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:35.944822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:35.953124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 537/1090] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:20:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:35.959633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:35.987313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.065710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175191f-83b9-41ff-929a-27d4f06c6f8e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.102599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.103274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.103551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.103818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.114241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.115634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:36.130442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:36.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:36.132752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:36.132752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:36.132752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:36.132752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 554/1091] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:36.137685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.143776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.174040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.226633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.245078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6d3db-fa57-4a7c-b798-e517bc714ee5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.245754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1c79b-2cf1-4805-8157-d03c3e73c9bd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.280961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.281588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.281868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.281980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.282145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.282520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.282830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.282966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:36.283215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.283802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.284812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.296252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:36.297389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 538/1092] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:36.302210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:36.303139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:36.303991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 555/1093] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:36.304681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.308644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.404752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.411579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b7b83-d158-47b6-96b3-3607090b1595 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.415020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b15c-81b2-4197-a60c-d8eacc06651c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.447200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.447835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.448117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.448391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.450468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.451111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.451393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.451665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.452333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:36.452635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.454022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.456336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.458105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.465201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 556/1094] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:36.471676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:20:36.472608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:36.473710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:36.474678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 539/1095] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:36.475323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.479325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.576688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06abaa-5d82-4ef6-94fe-a7084e6bf8a5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.582920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b382f0-aa93-4b8b-8f9e-36c34f0721dd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.615173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.615808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.616090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.616361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] PATH_INFO: `/v3/users/8dc1d9dd28a345c2b5f4e52ec979cc12` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.617540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] RBAC: Authorizing `identity:get_user(user_id=8dc1d9dd28a345c2b5f4e52ec979cc12)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.618999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.619921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.620535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.620673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 557/1096] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/users/8dc1d9dd28a345c2b5f4e52ec979cc12 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:36.620818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.621094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.621828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:36.622142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.623584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.626442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.642740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 540/1097] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:36.648364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.663315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.703341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.735493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9dc90-8f36-46d3-bd63-8649cc558b9a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.751486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbc6de-955e-44ea-922c-f27789dcb94d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:36.772053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.772665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.772937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.773207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.787388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:36.788006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:36.788289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:36.788563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:36.842644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.844127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.856773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:36.858227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:36.874054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.913761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.946428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 558/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:20:36.952190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:36.964015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 541/1099] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:20:36.969665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:37.055995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad6f9-ab19-408c-93f5-5acfc5343d86 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.075145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa529d-028d-4661-b835-0abcc1e24947 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.089576 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:37.092850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.093493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.093768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.094038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.095200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=3583ead0bf144acb8d2fda9f7c2ffa58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.096900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.103650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 559/1100] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:37.105575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:37.113041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.113691 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.114428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.114727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.125281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.126946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:20:37.143088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:37.144112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:20:37.145402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:20:37.145402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:20:37.145402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:37.145402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 542/1101] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:37.146730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:37.149902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:37.208732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a6e9-16e2-41b2-b857-8ad914106fa3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.244813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.245426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.245977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.245977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.246711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58, user.id=8dc1d9dd28a345c2b5f4e52ec979cc12) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:37.247023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.248583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.250783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979365-116e-4987-b954-8b14a4b08704 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.255935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 560/1102] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:37 2022] GET /identity/v3/role_assignments?user.id=8dc1d9dd28a345c2b5f4e52ec979cc12&scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:37.290827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.291466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.291746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.292021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.292689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:37.292993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.294386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.308614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 543/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:20:37.315283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:37.425587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da43da-92a9-4345-a390-9ba2f7420dcb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.427246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:37.459878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.460569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.460845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.461111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.468160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.469972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:20:37.481991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:37.483002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:20:37.483930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 561/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:20:37.489860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:37.514876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:37.590014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938038-4f24-48e2-ae32-b059bb1eacc0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.626092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.627284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.627569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.627830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.628521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:37.628826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.630238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04d48-24c2-427d-aa3f-8bd04e697936 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.647483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 544/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:37.649007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:37.745981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3290-40a6-4d86-8107-cc0e70207b1a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:37.779860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:37.780457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:37.780735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:37.781006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:37.781735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] RBAC: Adding query filter params (role.id=f06679f1c3b945e79146a6a7ea9617e4, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=5704b06613b94c92896a39fc2b24c280) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:37.782039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:37.784406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35f0ef-4bfd-400e-ba74-42029d5d061d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:37.790151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 562/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:37 2022] GET /identity/v3/role_assignments?user.id=5704b06613b94c92896a39fc2b24c280&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=f06679f1c3b945e79146a6a7ea9617e4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:39.215664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c96e-6fd0-48c3-ad3b-cee64964d6bf None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:39.216320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c96e-6fd0-48c3-ad3b-cee64964d6bf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:39.216320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c96e-6fd0-48c3-ad3b-cee64964d6bf None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:39.217514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 545/1107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:39.222738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:39.223154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:39.223296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:39.241162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:39.242348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:39.263203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:39.309343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 563/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:39.577299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59c96e-6fd0-48c3-ad3b-cee64964d6bf None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:39.664270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:39.680579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59c96e-6fd0-48c3-ad3b-cee64964d6bf None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:39.714932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f129d-3332-4b64-9f89-49bc11d4664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:39.715555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f129d-3332-4b64-9f89-49bc11d4664c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:39.715835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f129d-3332-4b64-9f89-49bc11d4664c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:39.716108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f129d-3332-4b64-9f89-49bc11d4664c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:39.717219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f129d-3332-4b64-9f89-49bc11d4664c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:39.718632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f129d-3332-4b64-9f89-49bc11d4664c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:39.720793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 546/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:39.726765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:39.823712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baa553-6895-4c35-87ff-e62ade43b21b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:39.856970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe977e3d-c994-4164-b1a9-55850b84b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:39.857505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe977e3d-c994-4164-b1a9-55850b84b7dd None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:39.857784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe977e3d-c994-4164-b1a9-55850b84b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:39.858059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe977e3d-c994-4164-b1a9-55850b84b7dd None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:39.858718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe977e3d-c994-4164-b1a9-55850b84b7dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:39.860161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe977e3d-c994-4164-b1a9-55850b84b7dd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:39.946611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 564/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:20:39 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:41.877682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07822b-8640-43b3-b6bd-b0a6c0e8c510 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:41.878206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07822b-8640-43b3-b6bd-b0a6c0e8c510 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:41.878206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07822b-8640-43b3-b6bd-b0a6c0e8c510 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:41.879466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 547/1111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:41.884567 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:41.884962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:41.885124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:41.903109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:41.904295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:41.911590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:41.971304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 565/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:42.235282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07822b-8640-43b3-b6bd-b0a6c0e8c510 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:42.333833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07822b-8640-43b3-b6bd-b0a6c0e8c510 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:42.366978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:42.367593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:42.367867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:42.368134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] PATH_INFO: `/v3/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:42.369497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] RBAC: Authorizing `identity:get_role(role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:42.370948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:42.372293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 548/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:42 2022] GET /identity/v3/roles/17bb4391783f400d995fb75b6e3f4684 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:42.378644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:42.474968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e1b1a-9562-4450-be39-0bf3ec0e652c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:42.509116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:42.509675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:42.509953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:42.510225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] PATH_INFO: `/v3/users/066323a9d04a45b584de7d89c73c8697` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:42.521414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:42.523700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] RBAC: Authorizing `identity:get_user(user_id=066323a9d04a45b584de7d89c73c8697)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:42.525141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:42.526763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 566/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:42 2022] GET /identity/v3/users/066323a9d04a45b584de7d89c73c8697 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:42.532780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:42.555079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:42.633204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13be4-f241-4732-97ec-92395ac4c8aa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:42.666586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:42.667231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:42.667532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:42.667807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:42.735241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:42.737248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:42.756728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:42.832235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 549/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:42.838069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:42.936930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0c76-411e-49f1-b6de-f24e4f6c745d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:42.969462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537301a4-97ad-4e34-b642-409bf284c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:42.970797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537301a4-97ad-4e34-b642-409bf284c642 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:42.971162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537301a4-97ad-4e34-b642-409bf284c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:42.971441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537301a4-97ad-4e34-b642-409bf284c642 None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:42.972549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537301a4-97ad-4e34-b642-409bf284c642 None admin] RBAC: Authorizing `identity:get_project(project_id=3583ead0bf144acb8d2fda9f7c2ffa58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:42.973975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537301a4-97ad-4e34-b642-409bf284c642 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:42.975605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 567/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:42 2022] GET /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:42.981845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:43.078368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b16-c6c1-4473-839d-05502d2d1a32 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:43.097944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:43.111665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:43.112330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:43.112612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:43.112886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:43.113602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] RBAC: Adding query filter params (role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58, user.id=066323a9d04a45b584de7d89c73c8697) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:43.113911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:43.115355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab390f4-15bd-4082-ba9e-1b01991666a2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:43.120522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 550/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:42 2022] GET /identity/v3/role_assignments?user.id=066323a9d04a45b584de7d89c73c8697&scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:44.977257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb577b6-c6cb-4bb4-8484-7ac203f36962 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:44.977771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb577b6-c6cb-4bb4-8484-7ac203f36962 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:44.977880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb577b6-c6cb-4bb4-8484-7ac203f36962 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:44.979174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 568/1118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:44.984266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:44.984659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:44.984820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:45.003067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:45.004256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:45.071243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 551/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:45.336270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb577b6-c6cb-4bb4-8484-7ac203f36962 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:45.402866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:45.436241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb577b6-c6cb-4bb4-8484-7ac203f36962 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:45.470872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:45.471489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:45.471766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:45.472038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] PATH_INFO: `/v3/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:45.473416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] RBAC: Authorizing `identity:get_role(role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:45.474801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:45.476104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 569/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:45 2022] GET /identity/v3/roles/17bb4391783f400d995fb75b6e3f4684 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:45.482061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:45.578363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8f9a-7981-4c85-83c3-79b802f8939b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:45.592443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:45.612350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:45.612978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:45.613257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:45.613530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] PATH_INFO: `/v3/users/066323a9d04a45b584de7d89c73c8697` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:45.614810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] RBAC: Authorizing `identity:get_user(user_id=066323a9d04a45b584de7d89c73c8697)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:45.616787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:45.618432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 552/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:45 2022] GET /identity/v3/users/066323a9d04a45b584de7d89c73c8697 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:45.624308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:45.726739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26537da1-6c36-412d-ac03-20ee9f37a4b6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:45.759563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b421c-b656-4481-a25b-41883ff296ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:45.760174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b421c-b656-4481-a25b-41883ff296ae None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:45.760450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b421c-b656-4481-a25b-41883ff296ae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:45.760974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b421c-b656-4481-a25b-41883ff296ae None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:45.762060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b421c-b656-4481-a25b-41883ff296ae None admin] RBAC: Authorizing `identity:get_project(project_id=3583ead0bf144acb8d2fda9f7c2ffa58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:45.763511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b421c-b656-4481-a25b-41883ff296ae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:45.765099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 570/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:45 2022] GET /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:45.771219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:45.873504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bff7f-2fcd-46f0-bd39-e9b6ce0b0c2c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:45.906442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42057f23-c2d0-4c11-a5e6-b689bab53826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:45.907132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42057f23-c2d0-4c11-a5e6-b689bab53826 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:45.908055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42057f23-c2d0-4c11-a5e6-b689bab53826 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:45.908329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42057f23-c2d0-4c11-a5e6-b689bab53826 None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58/users/066323a9d04a45b584de7d89c73c8697/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:45.910453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42057f23-c2d0-4c11-a5e6-b689bab53826 None admin] RBAC: Authorizing `identity:create_grant(project_id=3583ead0bf144acb8d2fda9f7c2ffa58, user_id=066323a9d04a45b584de7d89c73c8697, role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:45.911913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42057f23-c2d0-4c11-a5e6-b689bab53826 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:46.008871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 553/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:20:45 2022] PUT /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58/users/066323a9d04a45b584de7d89c73c8697/roles/17bb4391783f400d995fb75b6e3f4684 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:20:47.978218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeeae4-ab23-4135-a968-3e3dfbdc1215 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:47.978777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeeae4-ab23-4135-a968-3e3dfbdc1215 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:47.978777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeeae4-ab23-4135-a968-3e3dfbdc1215 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:47.980114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 571/1124] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:47.986029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:47.986496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:47.986632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:48.004281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:48.005474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:48.040038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:48.070653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 554/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:48.352822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeeae4-ab23-4135-a968-3e3dfbdc1215 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:48.356747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:48.453859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeeae4-ab23-4135-a968-3e3dfbdc1215 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:48.487402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:48.488020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:48.488297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:48.488569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] PATH_INFO: `/v3/roles/17bb4391783f400d995fb75b6e3f4684` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:48.489945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] RBAC: Authorizing `identity:get_role(role_id=17bb4391783f400d995fb75b6e3f4684)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:48.491366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:48.492863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 572/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:48 2022] GET /identity/v3/roles/17bb4391783f400d995fb75b6e3f4684 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:48.498606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:48.599190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916a93-8c01-4395-bf35-b543a3c0f89c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:48.633931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:48.634494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:48.634806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:48.635082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] PATH_INFO: `/v3/users/066323a9d04a45b584de7d89c73c8697` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:48.636465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=066323a9d04a45b584de7d89c73c8697)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:48.637892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:48.639501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 555/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:48 2022] GET /identity/v3/users/066323a9d04a45b584de7d89c73c8697 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:48.645319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:48.715259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:48.745941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34f64-48bf-4f36-8ecb-f25d655fa453 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:48.780268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:48.780865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:48.781141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:48.781413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:48.848689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:48.850126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:48.915920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:48.946060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 573/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:48.952127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:48.997849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:49.059451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f927a-22bc-42ef-9014-2eb0707b6eb4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:49.092577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11708205-bedb-4314-8046-2f2240bc9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:49.093202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708205-bedb-4314-8046-2f2240bc9825 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:49.093483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708205-bedb-4314-8046-2f2240bc9825 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:49.093754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708205-bedb-4314-8046-2f2240bc9825 None admin] PATH_INFO: `/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:49.095720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708205-bedb-4314-8046-2f2240bc9825 None admin] RBAC: Authorizing `identity:get_project(project_id=3583ead0bf144acb8d2fda9f7c2ffa58)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:49.097144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708205-bedb-4314-8046-2f2240bc9825 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:49.098782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 556/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:48 2022] GET /identity/v3/projects/3583ead0bf144acb8d2fda9f7c2ffa58 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:49.104878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:49.200989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d39af-3429-4082-9d41-c16408dcd306 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:49.235310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:49.235996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:49.236277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:49.236550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:49.237277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] RBAC: Adding query filter params (role.id=17bb4391783f400d995fb75b6e3f4684, scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58, user.id=066323a9d04a45b584de7d89c73c8697) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:49.237584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:49.239029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ed51-af8e-4f66-81b3-baa9faa029d0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:49.244669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 574/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:49 2022] GET /identity/v3/role_assignments?user.id=066323a9d04a45b584de7d89c73c8697&scope.project.id=3583ead0bf144acb8d2fda9f7c2ffa58&role.id=17bb4391783f400d995fb75b6e3f4684 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:51.163345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d2d9-659e-459c-a314-85cfbfcde474 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:51.163988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d2d9-659e-459c-a314-85cfbfcde474 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:51.163988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d2d9-659e-459c-a314-85cfbfcde474 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:51.165719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 557/1131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:51.173776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:51.174200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:51.174314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:51.192804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:51.193998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:51.222930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:51.260166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 575/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:51.562658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d2d9-659e-459c-a314-85cfbfcde474 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:51.664200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d2d9-659e-459c-a314-85cfbfcde474 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:51.674307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:51.699100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590ef51-4f1b-49c6-b6a1-54b1f22c7b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:51.699794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590ef51-4f1b-49c6-b6a1-54b1f22c7b20 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:51.700359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590ef51-4f1b-49c6-b6a1-54b1f22c7b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:51.700645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590ef51-4f1b-49c6-b6a1-54b1f22c7b20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:51.701954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590ef51-4f1b-49c6-b6a1-54b1f22c7b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:51.703589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590ef51-4f1b-49c6-b6a1-54b1f22c7b20 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:51.705919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 558/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:51.711746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:51.817837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7da9-193c-4d5d-bb2e-315276e4a25f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:51.850920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03c0f7-a76d-4fb3-8efd-48445e5a0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:51.851514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c0f7-a76d-4fb3-8efd-48445e5a0a1f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:51.851790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c0f7-a76d-4fb3-8efd-48445e5a0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:51.852057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c0f7-a76d-4fb3-8efd-48445e5a0a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:51.852699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03c0f7-a76d-4fb3-8efd-48445e5a0a1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:51.854117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03c0f7-a76d-4fb3-8efd-48445e5a0a1f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:51.942220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 576/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:20:51 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:53.877148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002dc9d-1c2f-4465-97ca-a6dd69248538 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:53.877676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002dc9d-1c2f-4465-97ca-a6dd69248538 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:53.877676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002dc9d-1c2f-4465-97ca-a6dd69248538 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:53.878953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 559/1135] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:53.884424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:53.884890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:53.884992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:53.904072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:53.905290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:53.920707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:53.978216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 577/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:20:54.281000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002dc9d-1c2f-4465-97ca-a6dd69248538 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:54.381658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002dc9d-1c2f-4465-97ca-a6dd69248538 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:54.415433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17b99-005a-4520-93c4-62a00d71ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:54.416051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17b99-005a-4520-93c4-62a00d71ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:54.416327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17b99-005a-4520-93c4-62a00d71ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:54.416596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17b99-005a-4520-93c4-62a00d71ff13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:54.417721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17b99-005a-4520-93c4-62a00d71ff13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:54.419166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17b99-005a-4520-93c4-62a00d71ff13 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:54.420709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 560/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:20:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:54.426514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:54.530536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1bfa-79b0-47a0-870a-0e4a67cc45b2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:54.564155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c769c-3b68-4d6d-8ab1-ec1e2b29d2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:54.564694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c769c-3b68-4d6d-8ab1-ec1e2b29d2f5 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:54.564970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c769c-3b68-4d6d-8ab1-ec1e2b29d2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:54.565240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c769c-3b68-4d6d-8ab1-ec1e2b29d2f5 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:54.565873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c769c-3b68-4d6d-8ab1-ec1e2b29d2f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:54.567339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c769c-3b68-4d6d-8ab1-ec1e2b29d2f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:54.649741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 578/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:20:54 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:20:56.591529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a6d5-f815-4bf8-85e4-2be1b2865933 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:56.592176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a6d5-f815-4bf8-85e4-2be1b2865933 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:56.592176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724a6d5-f815-4bf8-85e4-2be1b2865933 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:56.593308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 561/1139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:56.600089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:56.600535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:56.601021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:56.608675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:56.620438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:56.622834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:20:56.690711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 579/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:20:56.965133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a6d5-f815-4bf8-85e4-2be1b2865933 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:57.011675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:57.065057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724a6d5-f815-4bf8-85e4-2be1b2865933 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:57.098306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:57.098978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:57.099254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:57.099531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:57.109393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:20:57.114926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:20:57.116149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:20:57.117257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 562/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:20:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:20:57.122139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:57.228860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fb312-c760-4efb-ad86-f818456f6697 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:57.262774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:57.263378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:57.263661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:57.263936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:57.264610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:57.264917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:57.267085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:57.268364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:57.275518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 580/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:57.281355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:57.379334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330084-8fcd-4d6f-afa3-26d44dc95b07 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:57.381626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:57.415519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:57.416145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:57.416429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:57.416704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] PATH_INFO: `/v3/users/dd37e9a09c6142089cf76304923dd636` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:57.430236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] RBAC: Authorizing `identity:get_user(user_id=dd37e9a09c6142089cf76304923dd636)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:57.431787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:57.433409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 563/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:20:57 2022] GET /identity/v3/users/dd37e9a09c6142089cf76304923dd636 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:57.439722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:57.546257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080b078-8228-4290-8e3b-29e3be5cda6d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:57.581237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:57.581841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:57.582124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:57.582400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:57.645499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:57.651920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:57.653385 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:57.753984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 581/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:20:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:20:57.759998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:57.857244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a43e7-f51f-4ca1-938f-d764c0f08b88 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:57.890532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f9856-9f6d-4876-81b8-a01856d10b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:57.891349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9856-9f6d-4876-81b8-a01856d10b21 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:57.891810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9856-9f6d-4876-81b8-a01856d10b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:57.892084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f9856-9f6d-4876-81b8-a01856d10b21 None admin] PATH_INFO: `/v3/projects/f2dc8f879bb9474bb07b264370ba040c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:57.893198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9856-9f6d-4876-81b8-a01856d10b21 None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc8f879bb9474bb07b264370ba040c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:57.894613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f9856-9f6d-4876-81b8-a01856d10b21 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:57.896254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 564/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:20:57 2022] GET /identity/v3/projects/f2dc8f879bb9474bb07b264370ba040c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:57.902620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:20:57.995556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:58.001813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167371-1055-4149-970c-8f935a77b4e2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:20:58.035548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:20:58.036141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:58.036416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:58.036681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:58.037397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=f2dc8f879bb9474bb07b264370ba040c, user.id=dd37e9a09c6142089cf76304923dd636) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:20:58.037699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:20:58.039172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddde2d6-fafe-42a0-8ae7-b8766fd495e4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:20:58.044375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 582/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:20:57 2022] GET /identity/v3/role_assignments?user.id=dd37e9a09c6142089cf76304923dd636&scope.project.id=f2dc8f879bb9474bb07b264370ba040c&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:20:59.914071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b0bd-6986-4b1e-a29e-8bbb6407516d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:59.914598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b0bd-6986-4b1e-a29e-8bbb6407516d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:59.914598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b0bd-6986-4b1e-a29e-8bbb6407516d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:59.915876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 565/1147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:20:59.920963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:20:59.921388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:20:59.921499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:20:59.940642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:20:59.941819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:00.008529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 583/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:20:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:00.274525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b0bd-6986-4b1e-a29e-8bbb6407516d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:00.305637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:00.375722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b0bd-6986-4b1e-a29e-8bbb6407516d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:00.409835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:00.410458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:00.410763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:00.411040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:00.420833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:21:00.425611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:21:00.426831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:21:00.428027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 566/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:21:00.432835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:00.520274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:00.532082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f72af-1a2d-41e7-930a-db9a20b2ce16 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:00.562938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:00.563534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:00.563809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:00.564075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:00.564732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:00.565026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:00.566380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:00.574315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 584/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:00.580817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:00.676536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:00.685558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5b885-386e-4bbf-81f2-165fc60dea63 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:00.718364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:00.719585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:00.719863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:00.720135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] PATH_INFO: `/v3/users/dd37e9a09c6142089cf76304923dd636` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:00.721241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] RBAC: Authorizing `identity:get_user(user_id=dd37e9a09c6142089cf76304923dd636)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:00.722649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:00.724235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 567/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:21:00 2022] GET /identity/v3/users/dd37e9a09c6142089cf76304923dd636 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:00.730261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:00.829444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8292a-adec-40cf-9c95-6a81e95b362e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:00.861394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8bfe5-fcc8-4b80-bf30-454e9ef7f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:00.862009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8bfe5-fcc8-4b80-bf30-454e9ef7f41a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:00.862288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8bfe5-fcc8-4b80-bf30-454e9ef7f41a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:00.862560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8bfe5-fcc8-4b80-bf30-454e9ef7f41a None admin] PATH_INFO: `/v3/projects/f2dc8f879bb9474bb07b264370ba040c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:00.863696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8bfe5-fcc8-4b80-bf30-454e9ef7f41a None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc8f879bb9474bb07b264370ba040c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:00.865115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8bfe5-fcc8-4b80-bf30-454e9ef7f41a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:00.866765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 585/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:21:00 2022] GET /identity/v3/projects/f2dc8f879bb9474bb07b264370ba040c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:00.872783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:00.970506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81591-fed8-44e0-b619-e12e209bc173 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:01.004372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ef34-e10e-4d19-b26a-c4538bc2503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:01.005027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ef34-e10e-4d19-b26a-c4538bc2503f None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:01.005304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ef34-e10e-4d19-b26a-c4538bc2503f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:01.005574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ef34-e10e-4d19-b26a-c4538bc2503f None admin] PATH_INFO: `/v3/projects/f2dc8f879bb9474bb07b264370ba040c/users/dd37e9a09c6142089cf76304923dd636/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:01.007472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ef34-e10e-4d19-b26a-c4538bc2503f None admin] RBAC: Authorizing `identity:create_grant(project_id=f2dc8f879bb9474bb07b264370ba040c, user_id=dd37e9a09c6142089cf76304923dd636, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:01.008926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ef34-e10e-4d19-b26a-c4538bc2503f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:01.088426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 568/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:21:00 2022] PUT /identity/v3/projects/f2dc8f879bb9474bb07b264370ba040c/users/dd37e9a09c6142089cf76304923dd636/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:21:02.975739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c902e-702f-4f05-9875-1426dabcc230 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:02.976291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c902e-702f-4f05-9875-1426dabcc230 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:02.976291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c902e-702f-4f05-9875-1426dabcc230 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:02.977622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 586/1154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:21:02.982944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:02.983427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:02.983509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:03.002025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:03.003251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:03.016729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:03.070474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 569/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:03.341964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c902e-702f-4f05-9875-1426dabcc230 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:03.365453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:03.447201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c902e-702f-4f05-9875-1426dabcc230 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:03.481333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:03.481951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:03.482226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:03.482494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:03.493502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:21:03.498075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:21:03.499230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:21:03.500232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 587/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:21:03.506135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:03.609007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12054-71ec-408d-a925-9638f012ea70 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:03.646891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:03.647501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:03.647780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:03.648049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:03.648713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:03.649017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:03.650385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:03.659501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 570/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:03.665337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:03.762633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:03.782343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521c6b8-9e59-49c3-a4b5-3c907f955cf6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:03.820384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:03.821018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:03.821293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:03.821562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] PATH_INFO: `/v3/users/dd37e9a09c6142089cf76304923dd636` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:03.822704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] RBAC: Authorizing `identity:get_user(user_id=dd37e9a09c6142089cf76304923dd636)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:03.824145 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:03.825713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 588/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:21:03 2022] GET /identity/v3/users/dd37e9a09c6142089cf76304923dd636 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:03.832570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:03.847120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:03.934783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a123d13-9aa5-4917-9dc9-51bd4022fbfc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:03.969165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:03.969772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:03.970054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:03.970324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:04.039759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:04.041200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:04.053736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:04.146310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 571/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:21:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:21:04.152421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:04.255541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c14bf-be15-4c79-86ba-4ac6e8b47087 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:04.289589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2ee3c-e4aa-4ec1-986f-47ff0009c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:04.290215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ee3c-e4aa-4ec1-986f-47ff0009c214 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:04.290490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ee3c-e4aa-4ec1-986f-47ff0009c214 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:04.290783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ee3c-e4aa-4ec1-986f-47ff0009c214 None admin] PATH_INFO: `/v3/projects/f2dc8f879bb9474bb07b264370ba040c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:04.291883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2ee3c-e4aa-4ec1-986f-47ff0009c214 None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc8f879bb9474bb07b264370ba040c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:04.293312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2ee3c-e4aa-4ec1-986f-47ff0009c214 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:04.294968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 589/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:21:04 2022] GET /identity/v3/projects/f2dc8f879bb9474bb07b264370ba040c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:04.302326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:04.401037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be42c5-fa8b-47c3-b188-e2561aa49f33 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:04.412177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:04.435337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:04.435940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:04.436220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:04.436479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:04.437201 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=f2dc8f879bb9474bb07b264370ba040c, user.id=dd37e9a09c6142089cf76304923dd636) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:04.438137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:04.439587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d192-9e78-4f99-8de2-25a841fee05d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:04.445872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 572/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:21:04 2022] GET /identity/v3/role_assignments?user.id=dd37e9a09c6142089cf76304923dd636&scope.project.id=f2dc8f879bb9474bb07b264370ba040c&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:06.472210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453dfb-4abb-4acc-9327-4e78a1e33f54 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:06.472788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453dfb-4abb-4acc-9327-4e78a1e33f54 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:06.472788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453dfb-4abb-4acc-9327-4e78a1e33f54 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:06.474096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 590/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:21:06.479588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:06.480061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:06.480167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:06.498474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:06.499715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:06.567879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 573/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:06.854033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453dfb-4abb-4acc-9327-4e78a1e33f54 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:06.873796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:06.970857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453dfb-4abb-4acc-9327-4e78a1e33f54 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:07.020793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:07.021695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:07.022129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:07.022581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:07.093917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:07.095306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:07.114145 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:07.196979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 591/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:21:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:21:07.203622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:07.305216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52601d-df15-47ab-b10e-dd819da14f95 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:07.307543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:07.339650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:07.340299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:07.340798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:07.341093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:07.348230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:07.349657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ad3e1030-b10e-4903-bdc1-feea6d6a8aa4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:21:07.361696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:21:07.362802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:21:07.363786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 574/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:21:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:21:07.369163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:07.470166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240c83-0b9c-4d21-9a9e-2e6ea6324098 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:07.487440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:07.505804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:07.506410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:07.506687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:07.506987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:07.507632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:07.507939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:07.509302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d12aa-01f9-4f66-ab62-dea6f996170b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:07.517335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 592/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 05:21:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:09.443444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bc5f-4bc2-42ea-83e5-3ffb93881d11 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:09.443988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bc5f-4bc2-42ea-83e5-3ffb93881d11 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:09.443988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bc5f-4bc2-42ea-83e5-3ffb93881d11 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:09.445313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 575/1167] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:21:09.450741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b043b-71ed-4a50-8204-03edae6ed7fe None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:09.451185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b043b-71ed-4a50-8204-03edae6ed7fe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:09.451305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b043b-71ed-4a50-8204-03edae6ed7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:09.470255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1d7b043b-71ed-4a50-8204-03edae6ed7fe None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:09.471482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1d7b043b-71ed-4a50-8204-03edae6ed7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:09.537906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 593/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:09.832110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843bc5f-4bc2-42ea-83e5-3ffb93881d11 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:09.935347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843bc5f-4bc2-42ea-83e5-3ffb93881d11 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:09.969641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872e67-4d00-463f-a1e9-993b27176f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:09.970244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872e67-4d00-463f-a1e9-993b27176f0c None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:09.970523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872e67-4d00-463f-a1e9-993b27176f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:09.970827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872e67-4d00-463f-a1e9-993b27176f0c None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:09.971499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872e67-4d00-463f-a1e9-993b27176f0c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:09.972864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872e67-4d00-463f-a1e9-993b27176f0c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:10.050408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 576/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Aug 24 05:21:09 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:21:12.059445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846090-997b-4fc0-a622-aebe924043fb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:12.060026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846090-997b-4fc0-a622-aebe924043fb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:12.060026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846090-997b-4fc0-a622-aebe924043fb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:12.061333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 594/1170] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:21:12.067384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:12.067819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:12.067918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:12.086353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:12.087587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:12.106326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:12.161031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 577/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:12.427930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846090-997b-4fc0-a622-aebe924043fb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:12.532594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846090-997b-4fc0-a622-aebe924043fb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:12.543581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:12.567690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49906418-c45a-4220-bc3d-b521ed91ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:12.568323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906418-c45a-4220-bc3d-b521ed91ce8b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:12.568598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906418-c45a-4220-bc3d-b521ed91ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:12.568868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906418-c45a-4220-bc3d-b521ed91ce8b None admin] PATH_INFO: `/v3/domains/bff8d1632b594aa68f93bf954fc9f347` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:12.580303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49906418-c45a-4220-bc3d-b521ed91ce8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=bff8d1632b594aa68f93bf954fc9f347)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:12.581761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49906418-c45a-4220-bc3d-b521ed91ce8b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:12.583466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 595/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Aug 24 05:21:12 2022] GET /identity/v3/domains/bff8d1632b594aa68f93bf954fc9f347 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:12.589401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:12.692570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d842eb3-5df5-4dcf-9cc8-ea21de7ee19e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:12.727792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb712c-46e4-4704-9253-3ba57c19008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:12.728401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb712c-46e4-4704-9253-3ba57c19008d None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:12.728676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb712c-46e4-4704-9253-3ba57c19008d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:12.728942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb712c-46e4-4704-9253-3ba57c19008d None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:12.729580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb712c-46e4-4704-9253-3ba57c19008d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:12.731022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb712c-46e4-4704-9253-3ba57c19008d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:12.804652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 578/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:21:12 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:21:14.816541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243554-3e81-45f4-ada3-7791ad34d70d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:14.817197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243554-3e81-45f4-ada3-7791ad34d70d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:14.817197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243554-3e81-45f4-ada3-7791ad34d70d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:14.818492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 596/1174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:21:14.828044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:14.828627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:14.828928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:14.850030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:14.857961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:14.863788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:14.983354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 579/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:21:15.264425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af243554-3e81-45f4-ada3-7791ad34d70d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:15.382625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af243554-3e81-45f4-ada3-7791ad34d70d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:15.419370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f09d-a901-4250-b151-b4c4361fbe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:15.420107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f09d-a901-4250-b151-b4c4361fbe56 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:15.420431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f09d-a901-4250-b151-b4c4361fbe56 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:15.420746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f09d-a901-4250-b151-b4c4361fbe56 None admin] PATH_INFO: `/v3/domains/bff8d1632b594aa68f93bf954fc9f347` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:15.422666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4f09d-a901-4250-b151-b4c4361fbe56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bff8d1632b594aa68f93bf954fc9f347)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:15.424202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4f09d-a901-4250-b151-b4c4361fbe56 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:15.425888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 597/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Aug 24 05:21:15 2022] GET /identity/v3/domains/bff8d1632b594aa68f93bf954fc9f347 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:15.432267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:15.553082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a791c-78b3-4ff1-8f43-3e8c3b3fcf50 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:15.591927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900df35-83fb-4a2a-aee9-f6786145d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:15.592548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900df35-83fb-4a2a-aee9-f6786145d1c5 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:15.592827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900df35-83fb-4a2a-aee9-f6786145d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:15.593238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900df35-83fb-4a2a-aee9-f6786145d1c5 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:15.594063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900df35-83fb-4a2a-aee9-f6786145d1c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:15.595621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900df35-83fb-4a2a-aee9-f6786145d1c5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:15.606372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:15.735188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 580/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:21:15 2022] POST /identity/v3/users => generated 311 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:21:17.839047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9446-4742-451d-80dc-0c1443d1ec73 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:17.839615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9446-4742-451d-80dc-0c1443d1ec73 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:17.839615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9446-4742-451d-80dc-0c1443d1ec73 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:17.841040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 598/1178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:21:17.846799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:17.847251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:17.847361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:17.866584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:17.867740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:17.941622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 581/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:18.210250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9446-4742-451d-80dc-0c1443d1ec73 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:18.258972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:18.326649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9446-4742-451d-80dc-0c1443d1ec73 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:18.362753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:18.363385 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:18.363659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:18.363926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:18.374935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:21:18.379766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:21:18.380979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:21:18.381901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 599/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:21:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:21:18.387327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:18.496389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73c937-fe4b-4da3-a084-b025f2b922f5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:18.520322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:18.532873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:18.533505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:18.533791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:18.534067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:18.534775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:18.535084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:18.536465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:18.545196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 582/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:18.551380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:18.654446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:18.658969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5771a-3153-467b-993c-a2210a0e443f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:18.692676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:18.693307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:18.693596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:18.693852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] PATH_INFO: `/v3/users/9713663f7d4048d3988d2edaae4ff8f2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:18.709005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] RBAC: Authorizing `identity:get_user(user_id=9713663f7d4048d3988d2edaae4ff8f2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:18.710450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:18.712161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 600/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:21:18 2022] GET /identity/v3/users/9713663f7d4048d3988d2edaae4ff8f2 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:18.718717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:18.832316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4bcb-5bd9-4390-afaa-4e39b8d18f3d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:18.874567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:18.875935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:18.875935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:18.875935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:18.935092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:18.951655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:18.953406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:19.074010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 583/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:21:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:21:19.081312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:19.192139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faba76-6d75-42c8-bc23-15b44b481929 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:19.231449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39506-941b-4bf3-bd0f-e3f0728e0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:19.232084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39506-941b-4bf3-bd0f-e3f0728e0744 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:19.232360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39506-941b-4bf3-bd0f-e3f0728e0744 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:19.232625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39506-941b-4bf3-bd0f-e3f0728e0744 None admin] PATH_INFO: `/v3/projects/30b40caf4ff44f90ba03d850098a414e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:19.234616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39506-941b-4bf3-bd0f-e3f0728e0744 None admin] RBAC: Authorizing `identity:get_project(project_id=30b40caf4ff44f90ba03d850098a414e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:19.236120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39506-941b-4bf3-bd0f-e3f0728e0744 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:19.237786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 601/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:21:19 2022] GET /identity/v3/projects/30b40caf4ff44f90ba03d850098a414e => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:19.244330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:19.333980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:19.350998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc56c-00be-43b5-bdff-e635d2214be5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:19.387966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:19.388594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:19.388870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:19.389141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:19.390476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=30b40caf4ff44f90ba03d850098a414e, user.id=9713663f7d4048d3988d2edaae4ff8f2) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:19.390907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:19.392346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45a043-bd3d-4539-b564-5b9117221cd4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:19.398347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 584/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:21:19 2022] GET /identity/v3/role_assignments?user.id=9713663f7d4048d3988d2edaae4ff8f2&scope.project.id=30b40caf4ff44f90ba03d850098a414e&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:21.333651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440531f-f780-4309-9a52-dc7da052b57e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:21.334193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440531f-f780-4309-9a52-dc7da052b57e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:21.334193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440531f-f780-4309-9a52-dc7da052b57e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:21.335613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 602/1186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:21:21.341074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:21.341524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:21.341629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:21.360429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:21.361638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:21.432548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 585/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:21:21.702925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440531f-f780-4309-9a52-dc7da052b57e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:21.728527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:21.806886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440531f-f780-4309-9a52-dc7da052b57e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:21.852061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:21.852896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:21.853323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:21.853731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:21.867180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:21:21.871927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:21:21.874279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:21:21.876280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 603/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:21:21.884472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:21.964910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:21.986387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7322ae-810c-46d6-9650-d60961e28772 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:22.021687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:22.022304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:22.022579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:22.022876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:22.023542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:22.023841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:22.025198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:22.034239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 586/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:22.040105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:22.131460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:22.152879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37453073-8741-4dc1-847c-8b01b1975f2a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:22.205493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:22.206463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:22.206930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:22.207354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] PATH_INFO: `/v3/users/9713663f7d4048d3988d2edaae4ff8f2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:22.209265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] RBAC: Authorizing `identity:get_user(user_id=9713663f7d4048d3988d2edaae4ff8f2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:22.211749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:22.214461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 604/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:21:22 2022] GET /identity/v3/users/9713663f7d4048d3988d2edaae4ff8f2 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:22.221407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:22.330654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52429e-ce92-4149-9917-e808e87173a8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:22.364495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f519-f2dd-47ed-82f1-2d57c72e8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:22.365234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f519-f2dd-47ed-82f1-2d57c72e8653 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:22.365401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f519-f2dd-47ed-82f1-2d57c72e8653 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:22.365677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f519-f2dd-47ed-82f1-2d57c72e8653 None admin] PATH_INFO: `/v3/projects/30b40caf4ff44f90ba03d850098a414e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:22.366848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2f519-f2dd-47ed-82f1-2d57c72e8653 None admin] RBAC: Authorizing `identity:get_project(project_id=30b40caf4ff44f90ba03d850098a414e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:22.368281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2f519-f2dd-47ed-82f1-2d57c72e8653 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:22.369923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 587/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:21:22 2022] GET /identity/v3/projects/30b40caf4ff44f90ba03d850098a414e => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:22.376937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:22.479463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e066800-e882-42f8-ae8b-5710b3e98b97 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:22.521645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd1c7-2669-4f63-acee-f8224c6cfdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:22.522320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd1c7-2669-4f63-acee-f8224c6cfdc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:22.522601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd1c7-2669-4f63-acee-f8224c6cfdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:22.522908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd1c7-2669-4f63-acee-f8224c6cfdc6 None admin] PATH_INFO: `/v3/projects/30b40caf4ff44f90ba03d850098a414e/users/9713663f7d4048d3988d2edaae4ff8f2/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:22.524867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd1c7-2669-4f63-acee-f8224c6cfdc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=30b40caf4ff44f90ba03d850098a414e, user_id=9713663f7d4048d3988d2edaae4ff8f2, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:22.526323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd1c7-2669-4f63-acee-f8224c6cfdc6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:22.599025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 605/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:21:22 2022] PUT /identity/v3/projects/30b40caf4ff44f90ba03d850098a414e/users/9713663f7d4048d3988d2edaae4ff8f2/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:21:24.546180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95b48-10c7-4544-8188-a65af9f57ad1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:24.546776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95b48-10c7-4544-8188-a65af9f57ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:24.546776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95b48-10c7-4544-8188-a65af9f57ad1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:24.548208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 588/1193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:21:24.553715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:24.554232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:24.554383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:24.573067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:21:24.574255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:21:24.581781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:24.643401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 606/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:21:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:21:24.910481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95b48-10c7-4544-8188-a65af9f57ad1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:24.923665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:25.014395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95b48-10c7-4544-8188-a65af9f57ad1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:25.050863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:25.051494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:25.051770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:25.052038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:25.062776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:21:25.068426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:21:25.069536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:21:25.070603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 589/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:21:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:21:25.076296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:25.180671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57cb7c-2a8d-4cb9-9b9b-08592b78fea1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:25.218091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:25.218825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:25.219108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:25.219378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:25.220051 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:25.220351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:25.221738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:25.230225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 607/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:25.237389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:25.307028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:25.341911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e31d-273c-4879-9640-3f27ccb07262 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:25.398018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:25.399005 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:25.399451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:25.399915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] PATH_INFO: `/v3/users/9713663f7d4048d3988d2edaae4ff8f2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:25.401754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] RBAC: Authorizing `identity:get_user(user_id=9713663f7d4048d3988d2edaae4ff8f2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:25.404393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:25.407636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 590/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 05:21:25 2022] GET /identity/v3/users/9713663f7d4048d3988d2edaae4ff8f2 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:25.413780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:25.417778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:25.520137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9009-de8f-4326-bdc1-86b4d05783f1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:25.558536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:25.559620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:25.559900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:25.560268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:25.627942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:25.629421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:25.632291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:25.736896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 608/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:21:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:21:25.743070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:25.861501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc959b-07db-4a94-9368-b37be3eac77e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:25.900397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17912449-ffd9-49b5-a59e-7a09bdd978f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:25.901033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912449-ffd9-49b5-a59e-7a09bdd978f8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:25.901318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912449-ffd9-49b5-a59e-7a09bdd978f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:25.901594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912449-ffd9-49b5-a59e-7a09bdd978f8 None admin] PATH_INFO: `/v3/projects/30b40caf4ff44f90ba03d850098a414e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:25.902745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17912449-ffd9-49b5-a59e-7a09bdd978f8 None admin] RBAC: Authorizing `identity:get_project(project_id=30b40caf4ff44f90ba03d850098a414e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:25.904166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17912449-ffd9-49b5-a59e-7a09bdd978f8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:25.905880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 591/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 05:21:25 2022] GET /identity/v3/projects/30b40caf4ff44f90ba03d850098a414e => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:25.912229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:21:26.017105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5754-c22d-46f9-9fab-2dbdc27d95aa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:21:26.019510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:26.051870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:21:26.052859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:21:26.053465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:21:26.054138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:21:26.054957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=30b40caf4ff44f90ba03d850098a414e, user.id=9713663f7d4048d3988d2edaae4ff8f2) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:21:26.055313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:21:26.056795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725edb-7e1e-46dc-b0d7-e3ec246dde24 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:21:26.064118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 609/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:21:25 2022] GET /identity/v3/role_assignments?user.id=9713663f7d4048d3988d2edaae4ff8f2&scope.project.id=30b40caf4ff44f90ba03d850098a414e&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:21:35.896071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:36.060187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=16 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:43.441367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618835c-1064-4056-8cf3-bf44bfde0401 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:43.441982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618835c-1064-4056-8cf3-bf44bfde0401 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:43.441982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618835c-1064-4056-8cf3-bf44bfde0401 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:43.443285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 592/1201] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:22:43.448937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:43.449415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:43.449519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:43.468825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:22:43.470053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:22:43.545094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 610/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:22:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:22:43.843617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618835c-1064-4056-8cf3-bf44bfde0401 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:43.952650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618835c-1064-4056-8cf3-bf44bfde0401 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:43.987210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:43.987859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:43.988144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:43.988417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:43.999182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:44.000644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:44.016209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:44.017394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:44.018431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:44.018431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:44.018431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:22:44.018431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 593/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:22:44.024051 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:44.127641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef03ed-2d47-4291-8f1b-b52068fc1c02 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:44.161755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:44.167720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:44.168440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:44.168726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:44.169029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:44.169700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:44.170010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:44.171520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0b5e2-75fb-4b44-adcc-632c5b4a2e49 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:44.185771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 611/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:44.192022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:44.249083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:44.298897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335730f-2d8a-46e3-bc2c-976db466a0a5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:44.333345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d163-7c74-493a-85df-0bd203d11e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:44.333977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d163-7c74-493a-85df-0bd203d11e0d None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:44.334273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d163-7c74-493a-85df-0bd203d11e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:44.334546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d163-7c74-493a-85df-0bd203d11e0d None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:44.335233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d163-7c74-493a-85df-0bd203d11e0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:44.341776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d163-7c74-493a-85df-0bd203d11e0d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:44.562289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 594/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 05:22:44 2022] POST /identity/v3/users => generated 251 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:22:46.548001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e13cdd-7bf9-41c9-aaee-15c275df5e68 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:46.548555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e13cdd-7bf9-41c9-aaee-15c275df5e68 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:46.548555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e13cdd-7bf9-41c9-aaee-15c275df5e68 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:46.549898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 612/1206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:22:46.555238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:46.555674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:46.555773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:46.574399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:22:46.575693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:22:46.646456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 595/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:22:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:22:46.915301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e13cdd-7bf9-41c9-aaee-15c275df5e68 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:47.019802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e13cdd-7bf9-41c9-aaee-15c275df5e68 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:47.055398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:47.056018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:47.056295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:47.056561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:47.068242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:22:47.072813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:47.074769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:47.076137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 613/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:47.080229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:47.119394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:47.185878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f873672-17f4-46ef-a1d4-f45af2820774 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:47.220417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:47.221136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:47.221417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:47.221695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:47.222358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:47.222661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:47.224061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:47.232587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 596/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:47.238594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:47.288829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:47.339716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878739f-69d7-4f6f-af98-4cb1ca372d50 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:47.374113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:47.374755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:47.375033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:47.375318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:47.387239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:47.389620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:47.404247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:47.407711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:47.408664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:47.408664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:47.408664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:47.408664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 614/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:47.411561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:47.509474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:47.512415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36a929-c618-41a6-abea-fcc9cebc9c29 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:47.546256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:47.546899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:47.547176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:47.547446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:47.548087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:47.548388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:47.549745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:47.561257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 597/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:47.567415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:47.670586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab1bbf-55d1-4ce3-b810-f8537ee8022a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:47.672242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:47.705668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:47.706337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:47.706638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:47.710477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:47.714600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:47.716092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:22:47.731868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:47.733314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:47.734656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 615/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:47.740028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:47.843855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245077f-0315-44fb-834d-dd98776c7062 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:47.878560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:47.879207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:47.879514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:47.879748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:47.880477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:47.880783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:47.882199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:47.900075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 598/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 05:22:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:47.906523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:48.009764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9fd3b-23f2-427d-88c4-772925b5d940 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:48.046497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:48.047136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:48.047417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:48.047691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:48.079236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:48.118033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:48.119439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:48.227045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 616/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:22:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:22:48.233671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:48.253383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:48.339781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8408ef8-68df-4cb5-b575-8046e32d1894 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:48.377235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:48.377800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:48.378181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:48.378454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:48.390876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:48.392488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:48.410338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:48.411711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:48.413024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:48.413024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:48.413024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:22:48.413024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 599/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:48.418185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:48.493066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:48.534160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a368-dd6e-447d-90d5-1132eba9606e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:48.570268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:48.571028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:48.571231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:48.571504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:48.572158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:48.572459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:48.573824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:48.585569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 617/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:48.592141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:48.668532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:48.700261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ce44c-62e4-454c-91ef-ba61f9e144a6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:48.735315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:48.735992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:48.736295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:48.736572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:48.743849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:48.745287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:22:48.757583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:48.759528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:22:48.760523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:22:48.761428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 600/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:48.765921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:48.867365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af450ab4-7ac6-452d-8a6e-15d9d06bacd2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:48.893077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:48.904770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:48.905379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:48.905655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:48.905927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:48.906638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:48.906963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:48.908412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3ddc-77d7-4b24-bb0d-3598e8f2b198 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:48.922009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 618/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:22:48.928769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:49.064797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b531-abbe-4232-841f-b8b2e20b91e5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:49.093858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:49.099814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:49.100433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:49.100778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:49.101054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:49.101793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=62840e2e8fc94605a933c66f34dee30b) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:49.102104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:49.103946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487671df-dd49-43f2-bdcb-0584bdeb7c48 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:49.110132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 601/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:22:48 2022] GET /identity/v3/role_assignments?user.id=62840e2e8fc94605a933c66f34dee30b&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:51.013935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589c5-e5d9-4bf9-a18d-7aca8d076fff None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:51.014506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589c5-e5d9-4bf9-a18d-7aca8d076fff None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:51.014506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589c5-e5d9-4bf9-a18d-7aca8d076fff None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:51.015888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 619/1220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:22:51.021290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:51.024222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:51.024222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:51.040544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:22:51.041749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:22:51.109160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 602/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:22:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:22:51.382739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327589c5-e5d9-4bf9-a18d-7aca8d076fff None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:51.486030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327589c5-e5d9-4bf9-a18d-7aca8d076fff None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:51.520704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:51.521320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:51.521594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:51.521862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:51.532744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:22:51.537532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:51.543086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:51.544194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 620/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:22:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:51.544893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:51.653552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03be64-7d69-4282-a674-3eb600fb4771 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:51.678591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:51.689555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:51.690160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:51.690437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:51.690734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:51.691397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:51.691697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:51.693051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:51.701113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 603/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:22:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:51.707101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:51.752149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:51.809655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4e99-132b-4bb5-bfac-9680079f465d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:51.843030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:51.843701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:51.843981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:51.844255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:51.854109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:51.855589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:51.870642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:51.872838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:51.873913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:51.873913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:51.873913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:51.873913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 621/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:51.878300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:51.980753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cd11a-b684-40c6-b050-4b0ea351413e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:52.020614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:52.021224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:52.021499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:52.022074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:52.022394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:52.022721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:52.024068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:52.036483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 604/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:52.042369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:52.136434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:52.143324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c57c0-9673-40e8-9415-f3ae88febc43 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:52.177113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:52.177741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:52.178018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:52.178288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:52.186549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:52.188028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:22:52.198833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:52.200132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:52.201110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 622/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:52.205994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:52.255214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:52.312024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92f50-bc54-4826-83ba-3094c296bff4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:52.345148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:52.345752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:52.346030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:52.346298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:52.347067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:52.347370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:52.348793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:52.366148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 605/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 05:22:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:52.372795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:52.475576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1344ddc-e9ec-45b5-ac88-da32efe6bcb3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:52.511497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:52.512050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:52.512443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:52.512716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:52.523119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:52.524593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:52.539209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:52.540392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:52.541469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:52.541469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:52.541469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:52.541469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 623/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:52.547059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:52.658007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e3771-71c6-4f95-b55d-ac17706b1810 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:52.660650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:52.696161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade226-e322-4757-ba40-83163520e253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:52.696789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade226-e322-4757-ba40-83163520e253 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:52.697066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade226-e322-4757-ba40-83163520e253 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:52.697335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade226-e322-4757-ba40-83163520e253 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:52.697993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ade226-e322-4757-ba40-83163520e253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:52.698295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ade226-e322-4757-ba40-83163520e253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:52.699946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ade226-e322-4757-ba40-83163520e253 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:52.712719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 606/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:52.719042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:52.728479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:52.818825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b00df-6fd3-40eb-8e14-1b1129992b36 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:52.853279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:52.853908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:52.854187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:52.854509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:52.861515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:52.863713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:22:52.874154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:52.875328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:52.876433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 624/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:52.881303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade226-e322-4757-ba40-83163520e253 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:52.982521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade226-e322-4757-ba40-83163520e253 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:53.016307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:53.016918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:53.017199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:53.017475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:53.018171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:53.018478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:53.020013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6a2bf-5594-47c9-95a7-cad5e406f6c2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:53.032876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 607/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:53.039296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:53.106095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:53.140743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720be41d-40b2-404c-8561-3e82bd9450e6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:53.183833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dc461-4189-4f2e-ba20-63148ae96c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:53.186574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc461-4189-4f2e-ba20-63148ae96c0a None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:53.186953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc461-4189-4f2e-ba20-63148ae96c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:53.187226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc461-4189-4f2e-ba20-63148ae96c0a None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/62840e2e8fc94605a933c66f34dee30b/roles/1ec3f78a8157475291bece7827a488ce` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:53.202386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dc461-4189-4f2e-ba20-63148ae96c0a None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=62840e2e8fc94605a933c66f34dee30b, role_id=1ec3f78a8157475291bece7827a488ce)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:53.203855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dc461-4189-4f2e-ba20-63148ae96c0a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:53.290911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 625/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:22:53 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/62840e2e8fc94605a933c66f34dee30b/roles/1ec3f78a8157475291bece7827a488ce => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:22:55.258373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99126b-2814-4c00-93bf-056b43843f00 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:55.259288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99126b-2814-4c00-93bf-056b43843f00 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:55.259387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99126b-2814-4c00-93bf-056b43843f00 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:55.260727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 608/1233] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:22:55.266603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:55.267111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:55.267200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:55.285763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:22:55.287009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:22:55.367992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 626/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:22:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:22:55.641450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99126b-2814-4c00-93bf-056b43843f00 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:55.666607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:55.743936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99126b-2814-4c00-93bf-056b43843f00 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:55.783760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:55.784386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:55.784669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:55.784943 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:55.795238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:22:55.800017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:55.800954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:22:55.801830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 609/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 05:22:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:55.807473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:55.853944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:55.906008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0c6b1-efc9-455e-a4ef-f67f89160794 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:55.940805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:55.941408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:55.941706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:55.941955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:55.942614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:55.942943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:55.944301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:55.952381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 627/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 05:22:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:55.958185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:56.045402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:56.061263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e28f1-931a-459c-bace-7c89531431d8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:56.093648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:56.094310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:56.094591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:56.094892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:56.105172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:56.107446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:56.123015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:56.129497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:56.130496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:56.130496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:56.130496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:22:56.130496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 610/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:22:56.130760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:56.235680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79722-0883-401d-9865-48c546dd1a71 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:56.244840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:56.271617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:56.272447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:56.272573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:56.272790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:56.273459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:56.273763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:56.275286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:56.287945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 628/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:56.294280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:56.395352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce8efc-bad0-4f21-9d74-0488313d3767 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:56.428384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:56.429014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:56.429297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:56.429574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:56.432395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:56.438287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:56.442178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:22:56.451491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:56.452534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:22:56.453508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 611/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:56.458467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:56.561881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef68d-b4fd-489d-ad8b-0706b6fce193 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:56.596983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:56.597600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:56.597883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:56.598157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:56.598936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:56.599239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:56.600676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:56.619046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 629/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 05:22:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:56.624967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:56.729463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4d9b3-eba1-45dc-bd2b-9ad6925165ee None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:56.764566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:56.765176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:56.765458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:56.765733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:56.828405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:56.834914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:56.836478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:56.935697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 612/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:22:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:22:56.941555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:56.969821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:57.042569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608832-38ab-4ae5-8373-ca7d35e45308 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:57.076544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:57.077162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:57.077437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:57.077705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:57.087492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:57.088944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:22:57.103885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:57.105046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:22:57.107058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:22:57.107058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:22:57.107058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:57.107058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 630/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:57.111815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:57.216370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:57.222061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb3098-278c-431f-9443-bbacf92afa70 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:57.256419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:57.257022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:57.257303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:57.257572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:57.258208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:57.258786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:57.260134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:57.271677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 613/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:57.278435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:57.364558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:57.387194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08dc84-9c9d-4505-b870-036558460ac4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:57.421005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:57.421627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:57.421910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:57.422182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:57.428908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:57.430369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:22:57.442544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:22:57.443663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:22:57.456457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 631/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:22:57.457079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:57.553049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569b23-32a0-48bb-9487-74533ea8e83b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:57.587601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:57.588222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:57.588502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:57.588778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:57.589475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:57.589782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:57.591866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc955e86-c3c4-49c0-b739-5a34cd290fdb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:57.604516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 614/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:57.611235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:22:57.715888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456917-ba23-48bc-9a7d-17c5597f1b8e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:22:57.750145 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:22:57.750863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:57.751210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:57.751498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:57.752253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] RBAC: Adding query filter params (role.id=1ec3f78a8157475291bece7827a488ce, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=62840e2e8fc94605a933c66f34dee30b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:22:57.752562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:22:57.753989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828298-4af7-4675-89a0-3e9b70143747 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:22:57.760132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 632/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:22:57 2022] GET /identity/v3/role_assignments?user.id=62840e2e8fc94605a933c66f34dee30b&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=1ec3f78a8157475291bece7827a488ce => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:22:59.755361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e2ad3-ca04-40b2-9f5a-aaa4c7d34637 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:59.755889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e2ad3-ca04-40b2-9f5a-aaa4c7d34637 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:59.755978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e2ad3-ca04-40b2-9f5a-aaa4c7d34637 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:59.757339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 615/1247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:22:59.763676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:22:59.764100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:22:59.764227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:22:59.770625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:59.783064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:22:59.784370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:22:59.853030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 633/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:22:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:23:00.142048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e2ad3-ca04-40b2-9f5a-aaa4c7d34637 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:00.160889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:00.245525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e2ad3-ca04-40b2-9f5a-aaa4c7d34637 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:00.289674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:00.290314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:00.290598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:00.290904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:00.310373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:23:00.315412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:00.316539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:00.317506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 616/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:23:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:00.323007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:00.423321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c970e0-1f2f-466b-b71c-d20b1b74c41c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:00.453997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:00.458950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:00.459560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:00.459838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:00.460111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:00.460826 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:00.461125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:00.462494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:00.471099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 634/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:23:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:00.477023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:00.557318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:00.580538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9270-b6e7-481e-826d-144a50234b0c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:00.615943 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:00.616582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:00.616861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:00.617133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:00.627977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:00.629411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:23:00.644096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:00.645072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:23:00.645990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:23:00.645990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:00.645990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:00.645990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 617/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:00.651371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:00.753946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d4b4-aeb0-48b4-baf6-15ea010196cf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:00.789033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:00.789677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:00.789902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:00.790169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:00.790960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:00.791264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:00.792643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:00.805427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 635/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:00.811685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:00.916031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e15111-fb17-4c8d-bff7-6a491b57ccab None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:00.945886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:00.954927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:00.955587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:00.955864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:00.956136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:00.965578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:00.967240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:23:00.979351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:00.981185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:00.982348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 618/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:00.987186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:01.048834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:01.093983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99f58-119f-4c4e-9ba3-3c26e7517ad2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:01.131185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:01.131797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:01.132072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:01.132339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:01.133078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:01.133655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:01.135148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:01.155885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 636/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 05:23:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:01.164703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:01.287814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671681af-4d59-4008-aefa-5af085dad4ca None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:01.322094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:01.322508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:01.322822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:01.323093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:01.391635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:01.404746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:01.406208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:01.510853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 619/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:23:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:23:01.517467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:01.620941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadf1d6-7b84-4c5a-aa2f-a939e2ee3b00 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:01.640659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:01.666232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:01.666892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:01.667170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:01.667447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:01.677685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:01.681208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:23:01.695072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:01.696365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:23:01.697316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:23:01.697316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:01.697316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:01.697316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 637/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:23:01.702962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:01.805909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:01.818231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23c40-fcbb-45a4-8ba0-3453c9f1e278 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:01.855631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:01.856307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:01.856586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:01.856854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:01.857509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:01.857878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:01.859275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:01.870704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 620/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:01.876940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:01.985821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec304a-98f5-4295-a88c-24cdcc71d155 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:02.023875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:02.024516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:02.024798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:02.025073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:02.033650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:02.035147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:23:02.048255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:02.049308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:02.050261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 638/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:02.055608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:02.163138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526fc2-7b78-4058-9e8d-89876fe4e6bc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:02.197277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:02.198022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:02.198300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:02.198569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:02.199469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:02.199748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:02.201156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58e8c-ea1b-4659-940c-1f29c3a66e86 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:02.213321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 621/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:02.220754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:02.248276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:02.323137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7f84-35b3-4a8a-9d36-210550615dab None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:02.357330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:02.357551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:02.357721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:02.358050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:02.358958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=62840e2e8fc94605a933c66f34dee30b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:02.359886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:02.361341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7e77-0106-497c-a9ab-1432d6d20c35 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:02.366991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 639/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:23:02 2022] GET /identity/v3/role_assignments?user.id=62840e2e8fc94605a933c66f34dee30b&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=afa0ce309d704597adab4050e9d32d4d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:04.322110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9c78-716e-4fd6-b664-6c58a111e411 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:04.322674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9c78-716e-4fd6-b664-6c58a111e411 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:04.322674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9c78-716e-4fd6-b664-6c58a111e411 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:04.324521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 622/1261] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:23:04.330127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:04.330624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:04.330751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:04.350461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:23:04.351978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:23:04.425415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 640/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:23:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:23:04.705778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9c78-716e-4fd6-b664-6c58a111e411 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:04.724465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:04.872334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9c78-716e-4fd6-b664-6c58a111e411 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:04.912452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:04.913096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:04.913376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:04.913649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:04.925688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:23:04.930639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:04.932277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:04.933236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 623/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:23:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:04.942507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:04.967554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:05.056769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09caa6-93f7-4d64-9d3c-0d7c1dbb98ab None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:05.103749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:05.104363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:05.104645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:05.104922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:05.106606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:05.106801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:05.108165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:05.119209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 641/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:23:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:05.129018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:05.221612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:05.265275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ce592-929e-413b-a617-9cc873307b21 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:05.302419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:05.303100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:05.303374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:05.303647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:05.318370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:05.319979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:23:05.336746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:05.338990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:23:05.344442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:23:05.344442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:05.344442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:05.344442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 624/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:23:05.345767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:05.498808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:05.524769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc254f-52ba-4290-93ca-ed2a2f5d2883 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:05.587606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:05.588237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:05.588523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:05.588806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:05.589508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:05.590024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:05.592418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:05.607469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 642/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:05.613483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:05.738631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26d81c-4c1a-4125-9dcf-573a1bce3461 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:05.762312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:05.778219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:05.778975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:05.779305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:05.779630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:05.788852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:05.790532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:23:05.805210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:05.807358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:05.810398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 625/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:23:05.815746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:05.950614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efdd17-a31f-4e94-9461-40bd530486c2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:05.990629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:05.991312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:05.991594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:05.991882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:05.992626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:05.992931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:05.994492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:06.009763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:06.022657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 643/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 05:23:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:23:06.032071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:06.176103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d947b5-0756-40e5-ade3-61964600449c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:06.224577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:06.225223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:06.225561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:06.225839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:06.238896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:06.240345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:23:06.266992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:06.268813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:23:06.270567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:23:06.270567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:06.270567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:06.270567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 626/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:23:06.275773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:06.413357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b327-860f-42b5-9f6b-8c6c41219753 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:06.481549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:06.482198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:06.482490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:06.482797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:06.483479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:06.483784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:06.485203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:06.498876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 644/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:23:06.508980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:06.561497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:06.658159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6237b-db38-4e0c-9088-235745dc3a41 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:06.713169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:06.713823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:06.714108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:06.714951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:06.723680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:06.725188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:23:06.738778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:06.744773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:06.746652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 627/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:06.748022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:06.822666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:06.914554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce887-d878-4034-98e9-5a7f9d490f5d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:06.986381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:06.987434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:06.989179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:06.989681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:06.990999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:06.991543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:06.994183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cfed4-93f7-4ceb-919a-418d1baa3b62 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:07.018977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 645/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:07.025415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:07.169914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:07.184153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b14e8-2506-4b5b-b4b3-9a7332b49258 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:07.228970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd17ec0-0aa7-466b-9e3e-950e45e34a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:07.229650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd17ec0-0aa7-466b-9e3e-950e45e34a9c None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:07.230674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd17ec0-0aa7-466b-9e3e-950e45e34a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:07.231102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd17ec0-0aa7-466b-9e3e-950e45e34a9c None admin] PATH_INFO: `/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/62840e2e8fc94605a933c66f34dee30b/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:07.233519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd17ec0-0aa7-466b-9e3e-950e45e34a9c None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad5e705b204ad38b95921dcabe2557, user_id=62840e2e8fc94605a933c66f34dee30b, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:07.235114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd17ec0-0aa7-466b-9e3e-950e45e34a9c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:07.344907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 628/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 05:23:07 2022] PUT /identity/v3/projects/3bad5e705b204ad38b95921dcabe2557/users/62840e2e8fc94605a933c66f34dee30b/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:23:09.407012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4df4-359b-4ef5-b29e-11e7763795d0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:09.407691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4df4-359b-4ef5-b29e-11e7763795d0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:09.407691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4df4-359b-4ef5-b29e-11e7763795d0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:09.409071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 646/1274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:23:09.416424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:09.417035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:09.417246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:09.440902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:23:09.442922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:23:09.558080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 629/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:23:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:23:09.869685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4df4-359b-4ef5-b29e-11e7763795d0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:09.989304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4df4-359b-4ef5-b29e-11e7763795d0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:10.007293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:10.024074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:10.024699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:10.024974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:10.025241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:10.036077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:23:10.040897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:10.042079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:10.043821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 647/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 05:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:10.048839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:10.134603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:10.153680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2770-f73e-4d2f-b4fe-78045c22e770 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:10.191897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:10.192545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:10.192795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:10.193061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:10.193741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:10.194046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:10.195457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:10.204732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 630/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 05:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:10.210779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:10.320368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1266f83-72bd-47a5-ba6d-ac4cf9e661db None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:10.356634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:10.357258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:10.357537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:10.357809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:10.367827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:10.369270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:23:10.384601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:10.388519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:23:10.389664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:23:10.389664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:10.389664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:10.389664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 648/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:10.391938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:10.496981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347084f-f9f2-4740-be76-6a2154caa12a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:10.538016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:10.538630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:10.538940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:10.539214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:10.539889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:10.540190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:10.541580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:10.554534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 631/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:10.562060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:10.595990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:10.667192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e21afc-4718-4e6a-8aa0-90a5f8a19c7f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:10.713370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727633f1-231a-4977-b113-525781a0170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:10.714001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727633f1-231a-4977-b113-525781a0170e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:10.714335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727633f1-231a-4977-b113-525781a0170e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:10.714847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727633f1-231a-4977-b113-525781a0170e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:10.722814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727633f1-231a-4977-b113-525781a0170e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:10.724273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727633f1-231a-4977-b113-525781a0170e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-727633f1-231a-4977-b113-525781a0170e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:23:10.737553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:10.739010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:10.740210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 649/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:10.744611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:10.749214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:10.861048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc14b-2abf-4cd7-8c05-a642094e3ea7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:10.900536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:10.901145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:10.901433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:10.902268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:10.903066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:10.903365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:10.904767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:10.922547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 632/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 05:23:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:10.928413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727633f1-231a-4977-b113-525781a0170e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:11.028895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:11.038361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727633f1-231a-4977-b113-525781a0170e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:11.076242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:11.076852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:11.077129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:11.077397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:11.149258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:11.150944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:11.257101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:11.268157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 650/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 05:23:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:23:11.275009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:11.339941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:11.379420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fc58-b36d-40be-acc8-f95de417a15a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:11.413520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:11.414148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:11.414425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:11.414725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:11.426346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:11.427872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:23:11.442291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:11.443481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:23:11.444593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:23:11.444593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:23:11.444593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:11.444593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 633/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:11.449426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:11.551102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47fd54-9a3d-4a1f-ac9e-e5a2fe83001a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:11.586563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:11.587264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:11.587549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:11.587824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:11.588492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:11.588792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:11.591032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:11.604765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 651/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 05:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:11.610752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:11.732261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d7d04-3988-4412-92cd-a298ad87aca4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:11.746573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:11.768532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:11.769174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:11.769462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:11.769735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:11.777393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:11.779544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:23:11.791270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:11.792776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 24 05:23:11.794095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 634/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 05:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:11.799194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:11.852401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:11.913577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638419-c60b-425b-9f9f-45cfd2df77ca None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:11.955707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:11.956317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:11.956704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:11.957026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:11.957764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:11.958076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:11.959550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ecb9d-fa73-4aff-87ab-158276d62c40 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:11.973639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 652/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 05:23:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:23:11.980477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:12.090885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe848d-99c5-4cfd-b049-88c3857314eb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:12.130465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:12.131027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:12.131309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:12.131580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:12.132319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] RBAC: Adding query filter params (role.id=afa0ce309d704597adab4050e9d32d4d, scope.project.id=3bad5e705b204ad38b95921dcabe2557, user.id=62840e2e8fc94605a933c66f34dee30b) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:12.132627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:12.134356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95522c8-e6d0-48a5-a1a8-d8fee38f3863 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:12.141754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 635/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 05:23:11 2022] GET /identity/v3/role_assignments?user.id=62840e2e8fc94605a933c66f34dee30b&scope.project.id=3bad5e705b204ad38b95921dcabe2557&role.id=afa0ce309d704597adab4050e9d32d4d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:14.154001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce702dc-e564-4784-933b-281984a393f1 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:14.154601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce702dc-e564-4784-933b-281984a393f1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:14.154601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce702dc-e564-4784-933b-281984a393f1 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:14.155935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 653/1288] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:23:14.161776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:14.163715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:14.163715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:14.181925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:23:14.185176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:23:14.215161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:14.256072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 636/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:23:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:23:14.533589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce702dc-e564-4784-933b-281984a393f1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:14.662948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce702dc-e564-4784-933b-281984a393f1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:14.675255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:14.702040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:14.702725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:14.703036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:14.703290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:14.703893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:14.705410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:14.715995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:14.717616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:14.718960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 654/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:23:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:23:14.723675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:14.850516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fb201-81d1-44fd-ae53-1b21e31ef626 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:14.899901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:14.901336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:14.902357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:14.902564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:14.903409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:14.903713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:14.905206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f039fd-0108-4c6b-917d-83f626bbf761 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:14.910998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 637/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 05:23:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:14.918117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:15.062037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751cdd-6d77-4f89-8719-a2cfc6aed477 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:15.108757 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:15.109699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:15.109987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:15.110578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:15.111342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:15.111643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:15.113033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f240e-1b96-4f23-bb5b-9a76cad3c944 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:15.118268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 655/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 05:23:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:17.090653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09af7-b62e-4451-8ceb-5033ba15a6d1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:17.091625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09af7-b62e-4451-8ceb-5033ba15a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:17.091625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09af7-b62e-4451-8ceb-5033ba15a6d1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:17.093142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 638/1293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:23:17.099115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7fdc-814f-4497-8d04-8fc6476c1d70 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:17.099948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7fdc-814f-4497-8d04-8fc6476c1d70 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:17.100124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7fdc-814f-4497-8d04-8fc6476c1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:17.119371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-641a7fdc-814f-4497-8d04-8fc6476c1d70 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:23:17.121171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-641a7fdc-814f-4497-8d04-8fc6476c1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:23:17.153816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:17.193083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 656/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:23:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:23:17.471624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09af7-b62e-4451-8ceb-5033ba15a6d1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:17.504512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:17.603859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09af7-b62e-4451-8ceb-5033ba15a6d1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:17.667800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5afb49-3cbc-4990-8f80-8c1fe4c18251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:17.668884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5afb49-3cbc-4990-8f80-8c1fe4c18251 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:17.669362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5afb49-3cbc-4990-8f80-8c1fe4c18251 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:17.669832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5afb49-3cbc-4990-8f80-8c1fe4c18251 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:17.671072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5afb49-3cbc-4990-8f80-8c1fe4c18251 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:17.673582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5afb49-3cbc-4990-8f80-8c1fe4c18251 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:17.770636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 639/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 05:23:17 2022] POST /identity/v3/services => generated 246 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:23:19.859662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde74f-cd01-4315-acbf-c6bab6319af0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:19.860229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde74f-cd01-4315-acbf-c6bab6319af0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:19.860229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde74f-cd01-4315-acbf-c6bab6319af0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:19.861519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 657/1296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:23:19.867383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:19.867982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:19.867982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:19.888021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:23:19.889903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:23:19.981478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 640/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:23:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:23:20.265599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfde74f-cd01-4315-acbf-c6bab6319af0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:20.375480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfde74f-cd01-4315-acbf-c6bab6319af0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:20.425736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:20.427010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:20.427010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:20.427010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:20.427688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:20.429074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:20.439111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:20.440514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:20.441760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 658/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:23:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:23:20.446442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:20.466518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:20.555334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e1886-b424-47ab-8a32-9cb14a154f01 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:20.591992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:20.592833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:20.593169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:20.593836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:20.595569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:20.595876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:20.597522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:20.603388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 641/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 05:23:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:20.610448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:20.647853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:20.747670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403cbd6-e1f0-4513-8527-66b201de4656 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:20.787521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:20.788123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:20.788409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:20.788678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:20.789395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] RBAC: Adding query filter params (interface=public, service_id=2b33b084e3d0462193b8fda941bd7053, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:20.789699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:20.791163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164f316-6158-4739-b197-059d4d99e541 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:20.797234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 659/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 05:23:20 2022] GET /identity/v3/endpoints?service_id=2b33b084e3d0462193b8fda941bd7053&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:23:20.803437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:20.897124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:20.916794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d73a7-f860-49b3-acf3-e5934d8418c9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:20.952638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58736-2acc-470f-a848-20d2af66bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:20.953266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58736-2acc-470f-a848-20d2af66bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:20.953541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58736-2acc-470f-a848-20d2af66bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:20.953812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58736-2acc-470f-a848-20d2af66bbf7 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:20.954430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f58736-2acc-470f-a848-20d2af66bbf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:20.955827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f58736-2acc-470f-a848-20d2af66bbf7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:20.962999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 642/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 05:23:20 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:23:23.010601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d96f-0f3c-494d-9232-df103c0a0cb0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:23.012006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d96f-0f3c-494d-9232-df103c0a0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:23.012006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d96f-0f3c-494d-9232-df103c0a0cb0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:23.013482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 660/1302] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:23:23.019588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:23.020395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:23.020581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:23.043508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:23:23.044731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:23:23.117488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 643/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:23:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:23:23.407977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d96f-0f3c-494d-9232-df103c0a0cb0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:23.509796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:23.517863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d96f-0f3c-494d-9232-df103c0a0cb0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:23.553373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:23.554010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:23.554293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:23.554571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:23.555200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:23.556668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:23:23.566951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:23:23.569008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Aug 24 05:23:23.570835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 661/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 05:23:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:23:23.577390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:23.662530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:23.686489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc486ed-9007-4617-b9b6-be8dd2240393 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:23.725816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:23.726437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:23.726742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:23.727020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:23.727666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:23:23.727970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:23.729343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3bcd-1453-442d-a01a-908738cb2e74 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:23.736124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 644/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 05:23:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:23:23.746160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:23:23.857587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c32da6-c99b-4892-8487-8f6cfcc3a67c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:23:23.897864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b577-f9c9-467f-a834-009f067c8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:23:23.898519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b577-f9c9-467f-a834-009f067c8eda None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:23:23.898883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b577-f9c9-467f-a834-009f067c8eda None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:23:23.899218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b577-f9c9-467f-a834-009f067c8eda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:23:23.900000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506b577-f9c9-467f-a834-009f067c8eda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:23:23.901994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506b577-f9c9-467f-a834-009f067c8eda None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:23:23.977099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 662/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:23:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:23:33.732625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=30 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:33.971946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:48.813063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000788b-bcb0-4ca8-abaf-68d5d090975c None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:48.813541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000788b-bcb0-4ca8-abaf-68d5d090975c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:48.813815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000788b-bcb0-4ca8-abaf-68d5d090975c None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:48.820023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 645/1307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:30:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:30:48.820996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044416-1c03-422c-b378-c813ac919fba None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:48.821433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044416-1c03-422c-b378-c813ac919fba None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:48.821709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044416-1c03-422c-b378-c813ac919fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:48.900760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-03044416-1c03-422c-b378-c813ac919fba None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:30:48.901986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-03044416-1c03-422c-b378-c813ac919fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:49.014471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 663/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:30:49.313454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5cbd7-219e-4543-aaa5-bca6e64d00f9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:49.313722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5cbd7-219e-4543-aaa5-bca6e64d00f9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:49.313993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5cbd7-219e-4543-aaa5-bca6e64d00f9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:49.315611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 646/1309] 10.222.0.27 () {54 vars in 965 bytes} [Wed Aug 24 05:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:30:49.323076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ecc72-4b45-4ec0-bbf3-cf0e65e3de95 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:49.323437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ecc72-4b45-4ec0-bbf3-cf0e65e3de95 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:49.323919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ecc72-4b45-4ec0-bbf3-cf0e65e3de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:49.419962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-844ecc72-4b45-4ec0-bbf3-cf0e65e3de95 None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:30:49.421493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-844ecc72-4b45-4ec0-bbf3-cf0e65e3de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:49.447528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:49.514274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 664/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Aug 24 05:30:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:30:49.523986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5cbd7-219e-4543-aaa5-bca6e64d00f9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:30:49.525826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bbf5cbd7-219e-4543-aaa5-bca6e64d00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:49.657416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5cbd7-219e-4543-aaa5-bca6e64d00f9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:30:49.742605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:30:49.743241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:49.743518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:49.743911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:49.745525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:49.804417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:49.862884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:30:49.864951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19450d-bca1-4905-a403-7597c69321e1 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:30:49.884970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 647/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:30:52.199227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9843-6e26-4e40-8bb1-602f58f168d5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:52.199788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9843-6e26-4e40-8bb1-602f58f168d5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:52.199788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9843-6e26-4e40-8bb1-602f58f168d5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:52.201352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 665/1312] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:30:52.207495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd5068-69c4-47b6-8aa7-18da3301c848 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:52.208528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd5068-69c4-47b6-8aa7-18da3301c848 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:52.208528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd5068-69c4-47b6-8aa7-18da3301c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:52.295041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-dcbd5068-69c4-47b6-8aa7-18da3301c848 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:30:52.296294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dcbd5068-69c4-47b6-8aa7-18da3301c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:52.407139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 648/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:30:52.689601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9843-6e26-4e40-8bb1-602f58f168d5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:30:52.691754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a21d9843-6e26-4e40-8bb1-602f58f168d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:52.795628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9843-6e26-4e40-8bb1-602f58f168d5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:30:52.867697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:52.870429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:30:52.871085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:52.871483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:52.871760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:52.873388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:52.984701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:30:52.986137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213964f-93d7-4f59-9bcd-6b5d30038d2b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:30:53.004924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 666/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:30:55.862910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e3137-f1b5-4607-9656-3b9886859cb0 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:55.863537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e3137-f1b5-4607-9656-3b9886859cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:55.863537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e3137-f1b5-4607-9656-3b9886859cb0 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:55.864741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 649/1315] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:30:55.870140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1aa1b-f519-43bb-b5e2-597f50e2188a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:55.870553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1aa1b-f519-43bb-b5e2-597f50e2188a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:55.870722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1aa1b-f519-43bb-b5e2-597f50e2188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:55.937592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e4d1aa1b-f519-43bb-b5e2-597f50e2188a None None] MFA Rules not processed for user `b28d99a293fb4273b56795832ee5d05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:30:55.938823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4d1aa1b-f519-43bb-b5e2-597f50e2188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:55.992516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:56.037755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 667/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:30:56.326592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e3137-f1b5-4607-9656-3b9886859cb0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:30:56.328199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e64e3137-f1b5-4607-9656-3b9886859cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:56.338742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:56.437444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e3137-f1b5-4607-9656-3b9886859cb0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:30:56.513331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:30:56.513932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:56.514215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:56.514490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:56.516403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:56.579935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:56.627344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:30:56.629572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c08dd7-d812-4915-bf0f-9c3113fba261 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:30:56.648219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 650/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:30:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:30:59.393548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198b1a-d932-4c10-af60-d3b929a3fd1b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:59.394706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198b1a-d932-4c10-af60-d3b929a3fd1b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:59.394706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198b1a-d932-4c10-af60-d3b929a3fd1b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:59.396041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 668/1318] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:30:59.401805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aee42-58fe-486e-935d-5f2200def44f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:30:59.402264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aee42-58fe-486e-935d-5f2200def44f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:30:59.402374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aee42-58fe-486e-935d-5f2200def44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:30:59.473467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-121aee42-58fe-486e-935d-5f2200def44f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:30:59.474873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-121aee42-58fe-486e-935d-5f2200def44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:59.571930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 651/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:30:59.863445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198b1a-d932-4c10-af60-d3b929a3fd1b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:30:59.865007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f6198b1a-d932-4c10-af60-d3b929a3fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:30:59.969420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198b1a-d932-4c10-af60-d3b929a3fd1b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:00.044250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:00.044859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:00.045134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:00.045402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:00.047157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:00.054698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:00.159433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:00.161442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5bdb-1c0f-4e1f-a42c-dfde8c98a8ff service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:00.180677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 669/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:30:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:03.196854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9190-e852-45e2-b07b-4d5b20b1650f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:03.197429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9190-e852-45e2-b07b-4d5b20b1650f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:03.197429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9190-e852-45e2-b07b-4d5b20b1650f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:03.198748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 652/1321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:03.204125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0eb94-e0a0-44d6-bff8-4d866309cd03 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:03.204546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0eb94-e0a0-44d6-bff8-4d866309cd03 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:03.204756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0eb94-e0a0-44d6-bff8-4d866309cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:03.276436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-75a0eb94-e0a0-44d6-bff8-4d866309cd03 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:03.277667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75a0eb94-e0a0-44d6-bff8-4d866309cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:03.338639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:03.378113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 670/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:03.701919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8df58-9fac-4639-b832-804aea80ce2c None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:03.702311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8df58-9fac-4639-b832-804aea80ce2c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:03.702675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8df58-9fac-4639-b832-804aea80ce2c None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:03.704145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 653/1323] 10.222.0.27 () {54 vars in 965 bytes} [Wed Aug 24 05:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:03.710720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14c42-a0f1-44c6-b408-b9e69e52a192 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:03.711004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14c42-a0f1-44c6-b408-b9e69e52a192 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:03.711282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14c42-a0f1-44c6-b408-b9e69e52a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:03.791035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1ab14c42-a0f1-44c6-b408-b9e69e52a192 None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:03.792279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ab14c42-a0f1-44c6-b408-b9e69e52a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:03.871800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 671/1324] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Aug 24 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:03.880709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8df58-9fac-4639-b832-804aea80ce2c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:03.882348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-84d8df58-9fac-4639-b832-804aea80ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:03.903624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:03.999448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8df58-9fac-4639-b832-804aea80ce2c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:04.081447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:04.082062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:04.082353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:04.082621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:04.084294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:04.160298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:04.199399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:04.200841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d586c9-ce11-4246-af94-ac3eee738073 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:04.220807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 654/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:06.477492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11018f46-962c-4c37-b759-a6952ada6535 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:06.477937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11018f46-962c-4c37-b759-a6952ada6535 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:06.478029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11018f46-962c-4c37-b759-a6952ada6535 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:06.479444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 672/1326] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:06.485413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9415cf-e974-4f12-8bde-ab0dc9adabcc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:06.485956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9415cf-e974-4f12-8bde-ab0dc9adabcc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:06.485956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9415cf-e974-4f12-8bde-ab0dc9adabcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:06.554299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-da9415cf-e974-4f12-8bde-ab0dc9adabcc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:06.555551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-da9415cf-e974-4f12-8bde-ab0dc9adabcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:06.658525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 655/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:06.948791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11018f46-962c-4c37-b759-a6952ada6535 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:06.950435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-11018f46-962c-4c37-b759-a6952ada6535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:07.017678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:07.064454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11018f46-962c-4c37-b759-a6952ada6535 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:07.142267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:07.142900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:07.143192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:07.144085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:07.145722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:07.263990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:07.267234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:07.269369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56a97d-f035-47cb-97aa-b18f51d68def service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:07.287838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 673/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:09.302554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e788e-82e4-49bd-9023-23dc316ce835 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:09.303094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e788e-82e4-49bd-9023-23dc316ce835 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:09.303277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e788e-82e4-49bd-9023-23dc316ce835 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:09.308628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 656/1329] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:09.310284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e268-85c8-4544-a3f1-d422668eff17 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:09.310742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e268-85c8-4544-a3f1-d422668eff17 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:09.310859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e268-85c8-4544-a3f1-d422668eff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:09.384996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8915e268-85c8-4544-a3f1-d422668eff17 None None] MFA Rules not processed for user `b28d99a293fb4273b56795832ee5d05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:09.386252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8915e268-85c8-4544-a3f1-d422668eff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:09.488993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 674/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:09.781528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e788e-82e4-49bd-9023-23dc316ce835 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:09.783192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-365e788e-82e4-49bd-9023-23dc316ce835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:09.816937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:09.893118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e788e-82e4-49bd-9023-23dc316ce835 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:09.973348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:09.973987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:09.974271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:09.974544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:09.976414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:10.073476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:10.113806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:10.115443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747f6f1-2c6d-45e7-93e7-1d0b731d892d service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:10.139473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 657/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:12.918007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721d55-e106-4fcf-acef-a018963af0fd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:12.918532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721d55-e106-4fcf-acef-a018963af0fd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:12.918532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721d55-e106-4fcf-acef-a018963af0fd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:12.919857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 675/1332] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:12.926207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7a68-eb94-4fe7-aa5a-3adef9b1c33d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:12.926724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7a68-eb94-4fe7-aa5a-3adef9b1c33d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:12.926875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7a68-eb94-4fe7-aa5a-3adef9b1c33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:12.993753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-210e7a68-eb94-4fe7-aa5a-3adef9b1c33d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:12.994985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-210e7a68-eb94-4fe7-aa5a-3adef9b1c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:13.092091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 658/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:13.385730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721d55-e106-4fcf-acef-a018963af0fd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:13.387341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04721d55-e106-4fcf-acef-a018963af0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:13.458466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:13.495267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721d55-e106-4fcf-acef-a018963af0fd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:13.575299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:13.575908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:13.576188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:13.576461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:13.578064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:13.691232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:13.692657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bd3f4-268b-4f65-8489-50daa35fb6e4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:13.702534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:13.711686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 676/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:15.733564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7387e0-c0cd-432b-840d-f57beba9e201 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:15.734130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7387e0-c0cd-432b-840d-f57beba9e201 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:15.734130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7387e0-c0cd-432b-840d-f57beba9e201 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:15.735480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 659/1335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:15.740798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9122e5-7975-46b8-89fe-ce31bcf479af None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:15.741244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9122e5-7975-46b8-89fe-ce31bcf479af None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:15.741350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9122e5-7975-46b8-89fe-ce31bcf479af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:15.808373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8f9122e5-7975-46b8-89fe-ce31bcf479af None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:15.809500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8f9122e5-7975-46b8-89fe-ce31bcf479af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:15.906507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 677/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:16.196766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7387e0-c0cd-432b-840d-f57beba9e201 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:16.198394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7c7387e0-c0cd-432b-840d-f57beba9e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:16.239103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:16.304475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7387e0-c0cd-432b-840d-f57beba9e201 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:16.377225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:16.377953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:16.378229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:16.378500 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:16.380119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:16.462711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:16.488443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:16.489890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a8dee-b916-4d58-8477-1932507185f3 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:16.509129 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 660/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:19.084764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debbd0e-ba38-4ceb-8303-d10022647396 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:19.085353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debbd0e-ba38-4ceb-8303-d10022647396 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:19.085353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debbd0e-ba38-4ceb-8303-d10022647396 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:19.086797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 678/1338] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:19.092168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73093b56-0b28-4240-9547-d9724e159ea0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:19.092600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73093b56-0b28-4240-9547-d9724e159ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:19.092734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73093b56-0b28-4240-9547-d9724e159ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:19.160955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-73093b56-0b28-4240-9547-d9724e159ea0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:19.162179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-73093b56-0b28-4240-9547-d9724e159ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:19.263402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 661/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:19.554274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debbd0e-ba38-4ceb-8303-d10022647396 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:19.556168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7debbd0e-ba38-4ceb-8303-d10022647396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:19.636718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:19.665295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debbd0e-ba38-4ceb-8303-d10022647396 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:19.738333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:19.738974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:19.739251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:19.739522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:19.741122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:19.852547 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:19.853909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590efbcc-a6b0-4de6-a863-4c068352c5b9 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:19.875909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 679/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:24.138961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128d4a-3048-4cc0-9972-bd13ab3541d0 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:24.139532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128d4a-3048-4cc0-9972-bd13ab3541d0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:24.139532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128d4a-3048-4cc0-9972-bd13ab3541d0 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:24.141095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 662/1341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:24.147039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a31063-13a2-421b-9ac9-499a8f8f5f10 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:24.147506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a31063-13a2-421b-9ac9-499a8f8f5f10 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:24.147622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a31063-13a2-421b-9ac9-499a8f8f5f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:24.153251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:24.216128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-01a31063-13a2-421b-9ac9-499a8f8f5f10 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:24.217361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-01a31063-13a2-421b-9ac9-499a8f8f5f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:24.322227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 680/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:24.616382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128d4a-3048-4cc0-9972-bd13ab3541d0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:24.618014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-06128d4a-3048-4cc0-9972-bd13ab3541d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:24.667864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:24.726438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128d4a-3048-4cc0-9972-bd13ab3541d0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:24.803878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:24.804409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:24.804688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:24.804958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:24.806555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:24.901237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:24.918873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:24.927826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7e4fb-7453-46b5-ac75-7b28be3ff52e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:24.938025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 663/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:28.067659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25804a7c-a428-4c8a-999e-b456f3c3e595 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:28.067659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25804a7c-a428-4c8a-999e-b456f3c3e595 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:28.067659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25804a7c-a428-4c8a-999e-b456f3c3e595 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:28.067659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 681/1344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:28.068415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4603b4-62e3-460b-a9b0-cd140a1ade3a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:28.068415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4603b4-62e3-460b-a9b0-cd140a1ade3a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:28.068870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4603b4-62e3-460b-a9b0-cd140a1ade3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:28.135655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ce4603b4-62e3-460b-a9b0-cd140a1ade3a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:28.136842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce4603b4-62e3-460b-a9b0-cd140a1ade3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:28.240859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 664/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:28.522295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25804a7c-a428-4c8a-999e-b456f3c3e595 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:28.523930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-25804a7c-a428-4c8a-999e-b456f3c3e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:28.618752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:28.636188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25804a7c-a428-4c8a-999e-b456f3c3e595 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:28.718064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:28.718672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:28.718976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:28.719240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:28.721473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:28.843412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:28.844900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0abfe0-fea5-4b49-a817-0ba6a7f171c9 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:28.864855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 682/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:33.087940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef5cd-a691-4d24-b674-e34e712a92a7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:33.088451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef5cd-a691-4d24-b674-e34e712a92a7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:33.088550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef5cd-a691-4d24-b674-e34e712a92a7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:33.089849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 665/1347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:33.095596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a1135-a29b-4dcb-939a-e69262eb2c3b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:33.096025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a1135-a29b-4dcb-939a-e69262eb2c3b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:33.096151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a1135-a29b-4dcb-939a-e69262eb2c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:33.126356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:33.188343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-769a1135-a29b-4dcb-939a-e69262eb2c3b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:33.190719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-769a1135-a29b-4dcb-939a-e69262eb2c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:33.302866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 683/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:31:33.589734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef5cd-a691-4d24-b674-e34e712a92a7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:33.591325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2a3ef5cd-a691-4d24-b674-e34e712a92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:33.654919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:33.708249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef5cd-a691-4d24-b674-e34e712a92a7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:33.790247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:33.790961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:33.791236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:33.791515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:33.793131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:33.901611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:33.904800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:33.906277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f617b1-9fbf-435f-8eeb-b67947c1d9ae service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:33.925191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 666/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:39.064996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cdaf1-4fe4-4a6b-a064-6f26eca06eb3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:39.071932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cdaf1-4fe4-4a6b-a064-6f26eca06eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:39.071932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cdaf1-4fe4-4a6b-a064-6f26eca06eb3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:39.078766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 684/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:31:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:39.083584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9186062-c2da-48d1-b2ba-b1b8a21a9046 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:39.084074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9186062-c2da-48d1-b2ba-b1b8a21a9046 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:39.084173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9186062-c2da-48d1-b2ba-b1b8a21a9046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:39.210000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a9186062-c2da-48d1-b2ba-b1b8a21a9046 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:39.211923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a9186062-c2da-48d1-b2ba-b1b8a21a9046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:39.376072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 667/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:31:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:43.300915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=59 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:43.972021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90061ee-abb2-4118-a54e-4f08b813670c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:43.973216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90061ee-abb2-4118-a54e-4f08b813670c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:43.973701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90061ee-abb2-4118-a54e-4f08b813670c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:43.976223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 685/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:31:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:43.981820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23989-29f2-429e-a200-1c559fd87131 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:43.982301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23989-29f2-429e-a200-1c559fd87131 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:43.982384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23989-29f2-429e-a200-1c559fd87131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:44.041637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:44.066336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d1b23989-29f2-429e-a200-1c559fd87131 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:44.067675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d1b23989-29f2-429e-a200-1c559fd87131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:44.185115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 668/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:45.609365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554df088-fe2b-4f2b-98e9-ac2e77f7cf12 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:45.609923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554df088-fe2b-4f2b-98e9-ac2e77f7cf12 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:45.609923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554df088-fe2b-4f2b-98e9-ac2e77f7cf12 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:45.612786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 686/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:45.623551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a8e9-dcc4-4094-91c2-d8d38cf567f7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:45.623551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a8e9-dcc4-4094-91c2-d8d38cf567f7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:45.623551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a8e9-dcc4-4094-91c2-d8d38cf567f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:45.700762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b780a8e9-dcc4-4094-91c2-d8d38cf567f7 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:45.701998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b780a8e9-dcc4-4094-91c2-d8d38cf567f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:45.759301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:45.835088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 669/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:31:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:49.192919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ae0e-1537-40e5-8cf4-bbd2be70765d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:49.193422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ae0e-1537-40e5-8cf4-bbd2be70765d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:49.193422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ae0e-1537-40e5-8cf4-bbd2be70765d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:49.194811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 687/1356] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:49.201364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ec8d-bd81-45d5-a52e-75c32315dffc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:49.201810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ec8d-bd81-45d5-a52e-75c32315dffc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:49.201920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ec8d-bd81-45d5-a52e-75c32315dffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:49.271822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f229ec8d-bd81-45d5-a52e-75c32315dffc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:49.273035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f229ec8d-bd81-45d5-a52e-75c32315dffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:49.413475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 670/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:31:49.742352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c931-c7e5-496f-ada2-d963831b4c1a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:49.742925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c931-c7e5-496f-ada2-d963831b4c1a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:49.743426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c931-c7e5-496f-ada2-d963831b4c1a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:49.744978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 688/1358] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 05:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:49.753376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c98a-0f0b-4835-afd2-6a0369ab35f1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:49.753751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c98a-0f0b-4835-afd2-6a0369ab35f1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:49.753991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c98a-0f0b-4835-afd2-6a0369ab35f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:49.788397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:49.871899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f833c98a-0f0b-4835-afd2-6a0369ab35f1 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:49.873489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f833c98a-0f0b-4835-afd2-6a0369ab35f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:50.003727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 671/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 05:31:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:31:50.012617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c931-c7e5-496f-ada2-d963831b4c1a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:50.014222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-89d7c931-c7e5-496f-ada2-d963831b4c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:50.188377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c931-c7e5-496f-ada2-d963831b4c1a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:50.274309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:50.319664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:50.320275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:50.320557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:50.320831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:50.322555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:50.418111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:50.419740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd651bb-523c-47bb-9f3f-87b161ecc7d1 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:50.437714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 689/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:52.617627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546b3c-20b3-47c1-9b16-9a7bef51d33c None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:52.618131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546b3c-20b3-47c1-9b16-9a7bef51d33c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:52.618224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546b3c-20b3-47c1-9b16-9a7bef51d33c None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:52.619669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 672/1361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:52.624641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a297a7-9e97-4197-bfd3-aaae44d3a076 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:52.625044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a297a7-9e97-4197-bfd3-aaae44d3a076 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:52.625226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a297a7-9e97-4197-bfd3-aaae44d3a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:52.708847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-39a297a7-9e97-4197-bfd3-aaae44d3a076 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:52.710136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-39a297a7-9e97-4197-bfd3-aaae44d3a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:52.751700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:52.823373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 690/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:53.120259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c546b3c-20b3-47c1-9b16-9a7bef51d33c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:53.121799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5c546b3c-20b3-47c1-9b16-9a7bef51d33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:53.192901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:53.281437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c546b3c-20b3-47c1-9b16-9a7bef51d33c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:53.408156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:53.408874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:53.409216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:53.409563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:53.411263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:53.435042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:53.504856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:53.506362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650d23d-0a45-440a-81cb-8b5974cdfd6f service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:53.527855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 673/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:56.022959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94afe-1c4d-4ea1-8884-f8d44b8a302b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:56.023585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94afe-1c4d-4ea1-8884-f8d44b8a302b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:56.023585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94afe-1c4d-4ea1-8884-f8d44b8a302b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:56.024864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 691/1364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:56.030368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743560-d6e4-485a-b6f0-4b79c18f9436 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:56.030840 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743560-d6e4-485a-b6f0-4b79c18f9436 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:56.030933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743560-d6e4-485a-b6f0-4b79c18f9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:56.110819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6f743560-d6e4-485a-b6f0-4b79c18f9436 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:56.112050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6f743560-d6e4-485a-b6f0-4b79c18f9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:56.225643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:56.236144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 674/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:56.539368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829c5eb-2952-4b4d-82d6-6217abc693db None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:56.539762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829c5eb-2952-4b4d-82d6-6217abc693db None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:56.539762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829c5eb-2952-4b4d-82d6-6217abc693db None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:56.541647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 692/1366] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 05:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:56.548586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804ea2f-e286-49c5-ae04-bf122ba27141 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:56.549016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804ea2f-e286-49c5-ae04-bf122ba27141 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:56.549301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804ea2f-e286-49c5-ae04-bf122ba27141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:56.649111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6804ea2f-e286-49c5-ae04-bf122ba27141 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:56.650331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6804ea2f-e286-49c5-ae04-bf122ba27141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:56.778612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 675/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 05:31:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:56.786581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829c5eb-2952-4b4d-82d6-6217abc693db None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:56.788144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9829c5eb-2952-4b4d-82d6-6217abc693db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:56.957124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829c5eb-2952-4b4d-82d6-6217abc693db None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:56.979025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:57.079839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:57.080503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:57.080766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:57.080884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:57.082734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:57.197571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:57.199206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e63f0-d9da-41eb-bfdd-e42e4777bdea service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:57.220132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 693/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:31:57.717495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737d63-1c58-4564-835c-95d408b0cf4b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:57.718046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737d63-1c58-4564-835c-95d408b0cf4b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:57.718046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737d63-1c58-4564-835c-95d408b0cf4b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:57.719653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 676/1369] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:31:57.725005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14070-8566-44fa-ac50-ab3e9b983aef None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:57.725307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14070-8566-44fa-ac50-ab3e9b983aef None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:57.725590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14070-8566-44fa-ac50-ab3e9b983aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:57.760037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:57.800914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-69d14070-8566-44fa-ac50-ab3e9b983aef None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:57.802138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-69d14070-8566-44fa-ac50-ab3e9b983aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:57.909727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 694/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:58.525224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7c40-3dae-4b14-b7fb-2db65ed98cb4 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:58.525770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7c40-3dae-4b14-b7fb-2db65ed98cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:58.526211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7c40-3dae-4b14-b7fb-2db65ed98cb4 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:58.528081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 677/1371] 10.222.0.27 () {54 vars in 964 bytes} [Wed Aug 24 05:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:58.534243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc28c6-f472-4470-8327-559610fffd1e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:58.534800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc28c6-f472-4470-8327-559610fffd1e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:58.534800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc28c6-f472-4470-8327-559610fffd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:58.621133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b2fc28c6-f472-4470-8327-559610fffd1e None None] MFA Rules not processed for user `dddbf44c00e7411db8084d75fee531e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:58.622378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b2fc28c6-f472-4470-8327-559610fffd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:58.675081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:58.707153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 695/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Aug 24 05:31:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:58.715003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d7c40-3dae-4b14-b7fb-2db65ed98cb4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:58.716916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-072d7c40-3dae-4b14-b7fb-2db65ed98cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:58.773455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:58.837265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d7c40-3dae-4b14-b7fb-2db65ed98cb4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:31:58.928575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:31:58.931155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:58.931155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:58.931155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:58.931466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:59.041868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:59.058485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:31:59.059958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b094-2a97-45b7-9620-da845eb2a74e service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:31:59.091560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 678/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:31:59.494588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613cfa-fd6b-4c10-8460-830b47c4992c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:59.494910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613cfa-fd6b-4c10-8460-830b47c4992c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:59.495187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613cfa-fd6b-4c10-8460-830b47c4992c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:59.496597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 696/1374] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:31:59.502863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272e382-3f7a-45d6-8fa6-748b8f75712e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:59.503229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272e382-3f7a-45d6-8fa6-748b8f75712e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:59.503591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272e382-3f7a-45d6-8fa6-748b8f75712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:59.569518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7272e382-3f7a-45d6-8fa6-748b8f75712e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:31:59.570655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7272e382-3f7a-45d6-8fa6-748b8f75712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:31:59.675821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 679/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:31:59.974093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613cfa-fd6b-4c10-8460-830b47c4992c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:31:59.975670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-73613cfa-fd6b-4c10-8460-830b47c4992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:00.127772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613cfa-fd6b-4c10-8460-830b47c4992c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:00.183922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:00.252303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:00.252903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:00.253295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:00.253572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:00.255199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:00.345848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:00.347493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfcb15-db6b-4daa-87a8-ae5efa46f2e5 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:00.366559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 697/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:02.495959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79e8f-b5ac-4e5b-8d51-a86406541ffa None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:02.496538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79e8f-b5ac-4e5b-8d51-a86406541ffa None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:02.496538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79e8f-b5ac-4e5b-8d51-a86406541ffa None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:02.497760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 680/1377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:02.503398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e52433-3b7b-4601-8c20-6c05d7771940 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:02.503846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e52433-3b7b-4601-8c20-6c05d7771940 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:02.503950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e52433-3b7b-4601-8c20-6c05d7771940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:02.572479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-77e52433-3b7b-4601-8c20-6c05d7771940 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:02.573682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-77e52433-3b7b-4601-8c20-6c05d7771940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:02.580873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:02.680270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 698/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:02.981723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79e8f-b5ac-4e5b-8d51-a86406541ffa None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:02.983286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e8b79e8f-b5ac-4e5b-8d51-a86406541ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:03.056550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:03.153299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79e8f-b5ac-4e5b-8d51-a86406541ffa None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:03.285514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:03.286131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:03.286411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:03.286813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:03.288736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:03.310387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:03.393172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:03.394876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44ea04-5ecb-490c-862d-c281f51b5056 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:03.415820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 681/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:05.552935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556c21-3d35-44c4-93aa-140059358547 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:05.553451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556c21-3d35-44c4-93aa-140059358547 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:05.553451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556c21-3d35-44c4-93aa-140059358547 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:05.554970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 699/1380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:05.560464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957e676-c761-493f-bc20-d9b4645cc5f4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:05.560944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957e676-c761-493f-bc20-d9b4645cc5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:05.561026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957e676-c761-493f-bc20-d9b4645cc5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:05.639996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1957e676-c761-493f-bc20-d9b4645cc5f4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:05.641953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1957e676-c761-493f-bc20-d9b4645cc5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:05.748949 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:05.755142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 682/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:06.054097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556c21-3d35-44c4-93aa-140059358547 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:06.055826 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae556c21-3d35-44c4-93aa-140059358547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:06.219813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:06.231413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556c21-3d35-44c4-93aa-140059358547 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:06.366255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:06.366896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:06.367180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:06.367573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:06.369215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:06.475947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:06.477482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115c7b-ad6b-4c9f-9bc3-6daffc4f568e service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:06.488770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:06.497745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 700/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:08.781116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1d46-f713-43a9-b116-f454ef1e435a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:08.781691 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1d46-f713-43a9-b116-f454ef1e435a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:08.781801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1d46-f713-43a9-b116-f454ef1e435a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:08.783784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 683/1383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:08.789655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253ab38-e463-4299-8ab4-f13e42121a78 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:08.790280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253ab38-e463-4299-8ab4-f13e42121a78 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:08.790280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253ab38-e463-4299-8ab4-f13e42121a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:08.865464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c253ab38-e463-4299-8ab4-f13e42121a78 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:08.867214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c253ab38-e463-4299-8ab4-f13e42121a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:08.996531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 701/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:09.283751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1d46-f713-43a9-b116-f454ef1e435a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:09.285726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f3ec1d46-f713-43a9-b116-f454ef1e435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:09.461040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1d46-f713-43a9-b116-f454ef1e435a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:09.546332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:09.600397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:09.601189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:09.601286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:09.601530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:09.603502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:09.713879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:09.715595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f0df9-f9f1-4938-84e1-5db13b19f2a8 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:09.739734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 684/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:12.114934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899da50-a70c-4e09-8ded-2b660ef1738c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.115518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899da50-a70c-4e09-8ded-2b660ef1738c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.115518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899da50-a70c-4e09-8ded-2b660ef1738c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.116852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 702/1386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:12.123732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c85f-4bac-4c63-9dbc-227e5204b631 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.124266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c85f-4bac-4c63-9dbc-227e5204b631 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.124433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c85f-4bac-4c63-9dbc-227e5204b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.211613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6892c85f-4bac-4c63-9dbc-227e5204b631 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:12.213093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6892c85f-4bac-4c63-9dbc-227e5204b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:12.255240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.328503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 685/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:12.699979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899da50-a70c-4e09-8ded-2b660ef1738c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.701639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2899da50-a70c-4e09-8ded-2b660ef1738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:12.806448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.890717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899da50-a70c-4e09-8ded-2b660ef1738c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:13.043098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:13.044222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:13.044692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:13.045225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:13.047538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:13.101332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:13.162755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:13.162755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5499d1c-3e92-4fe4-ac26-9f8baadd239c service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:13.180819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 703/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:14.822403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9ab4-5653-47bd-9ae6-32e0cee1e2dd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:14.822995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9ab4-5653-47bd-9ae6-32e0cee1e2dd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:14.822995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9ab4-5653-47bd-9ae6-32e0cee1e2dd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:14.824547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 686/1389] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:14.830650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e61b3-504f-46f3-bd4e-f03bc8f6a269 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:14.831197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e61b3-504f-46f3-bd4e-f03bc8f6a269 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:14.831300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e61b3-504f-46f3-bd4e-f03bc8f6a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:14.911003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-519e61b3-504f-46f3-bd4e-f03bc8f6a269 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:14.912216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-519e61b3-504f-46f3-bd4e-f03bc8f6a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.025276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 704/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:15.333868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37edad-6860-41ea-8ffc-13bd5e3dfeae None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.334149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37edad-6860-41ea-8ffc-13bd5e3dfeae None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.334384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37edad-6860-41ea-8ffc-13bd5e3dfeae None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.338112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 687/1391] 10.222.0.27 () {54 vars in 967 bytes} [Wed Aug 24 05:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:15.343998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.344506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.345698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.356737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1e6f-adf4-4b7d-8b4b-124f29f50954 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.357567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1e6f-adf4-4b7d-8b4b-124f29f50954 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.357857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1e6f-adf4-4b7d-8b4b-124f29f50954 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.361174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 688/1392] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:15.364730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:15.366360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.366645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.366956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.439267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] MFA Rules not processed for user `68071674452b42839ffac496a902737d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:15.440598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.445981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:15.447233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.539457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 705/1393] 10.222.0.27 () {58 vars in 1064 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:15.546952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:15.555784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2d71a-7865-4738-b641-5b041fddc94e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:15.561494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 689/1394] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:32:15.648885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:15.649811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.650087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.650353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.651965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.689756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:15.778390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:15.779883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38a5c2-d951-40e2-9cb7-ddbfc9660a24 service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:15.821079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 706/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:32:15.878862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:15.880969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.899806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:16.030428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219a67-b842-4f15-a01e-4c2d6c2d33b0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.205192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.205192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.205192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.205192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.205676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:16.213769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:16.298570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.300342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3668c-2dd1-4711-bea3-b03686c7c3b8 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.320365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 690/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:16.910770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc744ce2-5d48-4ad0-8933-4f4bd7e0db71 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.911310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc744ce2-5d48-4ad0-8933-4f4bd7e0db71 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.911310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc744ce2-5d48-4ad0-8933-4f4bd7e0db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.990532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cc744ce2-5d48-4ad0-8933-4f4bd7e0db71 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:16.991981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cc744ce2-5d48-4ad0-8933-4f4bd7e0db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:17.088261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:17.098185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 707/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:32:17.146590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441b6e4-514c-4609-b8c4-42aaa4be09e5 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.147172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441b6e4-514c-4609-b8c4-42aaa4be09e5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.150039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441b6e4-514c-4609-b8c4-42aaa4be09e5 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.151633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 691/1398] 10.222.0.27 () {54 vars in 943 bytes} [Wed Aug 24 05:32:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:17.159898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0cd33-8517-4a62-9f78-ec21f26c616d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.160396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0cd33-8517-4a62-9f78-ec21f26c616d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.160786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0cd33-8517-4a62-9f78-ec21f26c616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.257500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4cc0cd33-8517-4a62-9f78-ec21f26c616d None None] MFA Rules not processed for user `bf51aca728a64f6ba4c143377a24b345`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:17.259012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4cc0cd33-8517-4a62-9f78-ec21f26c616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:17.382740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 708/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Aug 24 05:32:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:17.390125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441b6e4-514c-4609-b8c4-42aaa4be09e5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:17.392506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e441b6e4-514c-4609-b8c4-42aaa4be09e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:17.560654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441b6e4-514c-4609-b8c4-42aaa4be09e5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:17.565574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:17.683459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:17.683751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.684180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.684526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.686310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:17.780174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:17.782226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eca3ad-20c3-4924-9efb-8d4590c7f07e service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:17.793474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 692/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:32:18.547907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805fc09-77da-4051-903e-889e41639af6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:18.548915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805fc09-77da-4051-903e-889e41639af6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:18.549404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805fc09-77da-4051-903e-889e41639af6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:18.551422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 709/1401] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:18.556809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843d63-225f-4521-8f4b-a4a3a78ac535 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:18.557301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843d63-225f-4521-8f4b-a4a3a78ac535 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:18.557406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843d63-225f-4521-8f4b-a4a3a78ac535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:18.614458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:18.643629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-03843d63-225f-4521-8f4b-a4a3a78ac535 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:18.646210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-03843d63-225f-4521-8f4b-a4a3a78ac535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:18.782827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 693/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:19.091538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805fc09-77da-4051-903e-889e41639af6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:19.093416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d805fc09-77da-4051-903e-889e41639af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:19.183887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:19.305381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805fc09-77da-4051-903e-889e41639af6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:19.464031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:19.464644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:19.464924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:19.465200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:19.468847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:19.581193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:19.582839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a6451-b789-47ab-88ce-ac4eee8c28e1 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:19.626588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 710/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:19.839092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:22.000274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622a9f-a539-4a77-bcf6-02e738a09d96 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:22.000827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622a9f-a539-4a77-bcf6-02e738a09d96 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:22.000827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622a9f-a539-4a77-bcf6-02e738a09d96 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:22.003920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 694/1404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:22.007959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e909b0f-da01-4500-a9b0-5165cae5c46a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:22.008415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e909b0f-da01-4500-a9b0-5165cae5c46a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:22.008511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e909b0f-da01-4500-a9b0-5165cae5c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:22.089234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0e909b0f-da01-4500-a9b0-5165cae5c46a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:22.090475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0e909b0f-da01-4500-a9b0-5165cae5c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:22.213161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:22.223382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 711/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:22.529239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622a9f-a539-4a77-bcf6-02e738a09d96 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:22.530987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fc622a9f-a539-4a77-bcf6-02e738a09d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:22.695565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:22.754006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622a9f-a539-4a77-bcf6-02e738a09d96 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:22.930667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:22.931583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:22.932079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:22.932569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:22.934353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:23.033899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:23.057372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:23.059141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf6a6-1ebe-47f1-8892-700fe23069b8 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:23.078845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 695/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:25.274954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a403c7-6d7c-4f46-84a0-644f764279cc None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:25.275503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a403c7-6d7c-4f46-84a0-644f764279cc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:25.275503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a403c7-6d7c-4f46-84a0-644f764279cc None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:25.276890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 712/1407] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:25.282725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da62ba-96c5-4d82-a357-478435f78329 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:25.283306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da62ba-96c5-4d82-a357-478435f78329 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:25.283306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da62ba-96c5-4d82-a357-478435f78329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:25.357786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b5da62ba-96c5-4d82-a357-478435f78329 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:25.359088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b5da62ba-96c5-4d82-a357-478435f78329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:25.494780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 696/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:25.787659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a403c7-6d7c-4f46-84a0-644f764279cc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:25.789286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a7a403c7-6d7c-4f46-84a0-644f764279cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:25.954509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a403c7-6d7c-4f46-84a0-644f764279cc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:26.027772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:26.079068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:26.080207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.080498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.080772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.082428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:26.196364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:26.198558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3c61d-0ffd-47b9-ae85-db93e6e560f1 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:26.226683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 713/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:35.482418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=78 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:36.224351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=65 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.723050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c87d8-c0a5-4670-a38d-1604472629b1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.723620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c87d8-c0a5-4670-a38d-1604472629b1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.723620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c87d8-c0a5-4670-a38d-1604472629b1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.724976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 697/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Aug 24 05:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:42.730312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c291d37-caf7-4363-984f-95b74d12fc61 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.730775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c291d37-caf7-4363-984f-95b74d12fc61 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.730916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c291d37-caf7-4363-984f-95b74d12fc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.809017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2c291d37-caf7-4363-984f-95b74d12fc61 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:42.810226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2c291d37-caf7-4363-984f-95b74d12fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:42.919956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 714/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:42.934687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294e445-0bde-41ce-b0b8-f454c16a5fbf None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.935024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294e445-0bde-41ce-b0b8-f454c16a5fbf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.935308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294e445-0bde-41ce-b0b8-f454c16a5fbf None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.936638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 698/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Aug 24 05:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:42.941472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96dc8c-5c8b-4ad8-9d28-99d242aa45fe None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.941765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96dc8c-5c8b-4ad8-9d28-99d242aa45fe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.942044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96dc8c-5c8b-4ad8-9d28-99d242aa45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.016876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.020462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-be96dc8c-5c8b-4ad8-9d28-99d242aa45fe None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:43.021674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-be96dc8c-5c8b-4ad8-9d28-99d242aa45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:43.143209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 715/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:45.670289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740443-2fbe-427e-9f16-41fd31e2d77c None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.671762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740443-2fbe-427e-9f16-41fd31e2d77c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.671762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740443-2fbe-427e-9f16-41fd31e2d77c None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.673446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:45.681048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057e08-6efb-469b-b754-4d8f3267c73b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.681048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057e08-6efb-469b-b754-4d8f3267c73b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.682191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057e08-6efb-469b-b754-4d8f3267c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.756234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e5057e08-6efb-469b-b754-4d8f3267c73b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:45.757437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e5057e08-6efb-469b-b754-4d8f3267c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:45.819519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:45.869728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:46.161851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740443-2fbe-427e-9f16-41fd31e2d77c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.163438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a0740443-2fbe-427e-9f16-41fd31e2d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:46.327722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740443-2fbe-427e-9f16-41fd31e2d77c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.410207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:46.453450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.454066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.454357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.454631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.456331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:46.564318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:46.565959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f634e-96ba-4b04-8736-f17ec2f42910 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:46.589676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 700/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:47.526069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b685-05df-41ca-97bd-844411ebe549 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.526914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b685-05df-41ca-97bd-844411ebe549 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.527919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b685-05df-41ca-97bd-844411ebe549 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.529487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:47.537545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c6a1-185a-4a77-bb83-8a0803186d48 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.537545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c6a1-185a-4a77-bb83-8a0803186d48 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.538648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c6a1-185a-4a77-bb83-8a0803186d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.634149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4bb3c6a1-185a-4a77-bb83-8a0803186d48 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:47.635412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4bb3c6a1-185a-4a77-bb83-8a0803186d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:47.669207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:47.746635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:47.899857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b685-05df-41ca-97bd-844411ebe549 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:47.901295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1c34b685-05df-41ca-97bd-844411ebe549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:48.062634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b685-05df-41ca-97bd-844411ebe549 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:48.105796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:48.197722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:48.198248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:48.198682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:48.198985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:48.200627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:48.292735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:48.294342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b341bf-ddfa-4a31-909a-4ecc4fd9e051 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:48.313438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 718/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:49.260082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e32d3-2dc6-45e2-a52b-34cd809fd9d8 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.260736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e32d3-2dc6-45e2-a52b-34cd809fd9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.260736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e32d3-2dc6-45e2-a52b-34cd809fd9d8 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.262321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:49.270284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fd468-50d7-4ade-9ab2-2f6586df51d8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.270926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fd468-50d7-4ade-9ab2-2f6586df51d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.271137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fd468-50d7-4ade-9ab2-2f6586df51d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.341301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.366096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f10fd468-50d7-4ade-9ab2-2f6586df51d8 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:49.367425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f10fd468-50d7-4ade-9ab2-2f6586df51d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:49.472206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:49.629498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e32d3-2dc6-45e2-a52b-34cd809fd9d8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.631198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-950e32d3-2dc6-45e2-a52b-34cd809fd9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:49.796856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e32d3-2dc6-45e2-a52b-34cd809fd9d8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.810151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.918263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.918835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.919119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.919390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.921649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:50.023807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:50.025702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aa780-b79d-42a1-9381-a63fc53fb98c service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:50.047267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 703/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:51.006340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef1b3-ee41-4c47-97cb-e0b372333245 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.007038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef1b3-ee41-4c47-97cb-e0b372333245 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.007038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef1b3-ee41-4c47-97cb-e0b372333245 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.008427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:51.015484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e234f4-99f3-424c-9f74-17a5e6fac375 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.016002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e234f4-99f3-424c-9f74-17a5e6fac375 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.016002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e234f4-99f3-424c-9f74-17a5e6fac375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.037236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.101846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-40e234f4-99f3-424c-9f74-17a5e6fac375 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:51.103072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-40e234f4-99f3-424c-9f74-17a5e6fac375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:51.203897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:51.354484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef1b3-ee41-4c47-97cb-e0b372333245 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.355934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0b1ef1b3-ee41-4c47-97cb-e0b372333245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:51.468071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.504103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef1b3-ee41-4c47-97cb-e0b372333245 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.618495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.619074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.619352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.619625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.621232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:51.699419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.713625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:51.715323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e89828-5927-4b3d-ba8d-7601368b09d3 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:51.733380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 721/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:52.627962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df432c1f-6d22-4a3c-b4a9-2b1cb048eaaa None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.628521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df432c1f-6d22-4a3c-b4a9-2b1cb048eaaa None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.628521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df432c1f-6d22-4a3c-b4a9-2b1cb048eaaa None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.629888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:52.634835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a9ce-4ec2-47bd-acd7-b7e4d3950575 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.635275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a9ce-4ec2-47bd-acd7-b7e4d3950575 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.635449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a9ce-4ec2-47bd-acd7-b7e4d3950575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.714927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a294a9ce-4ec2-47bd-acd7-b7e4d3950575 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:52.716157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a294a9ce-4ec2-47bd-acd7-b7e4d3950575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:52.817530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:52.970982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df432c1f-6d22-4a3c-b4a9-2b1cb048eaaa None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:52.972526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df432c1f-6d22-4a3c-b4a9-2b1cb048eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:53.057100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.122970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df432c1f-6d22-4a3c-b4a9-2b1cb048eaaa None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.243465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.244104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.244399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.244653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.246307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:53.297082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.338438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:53.340074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f3809-5703-4537-9f08-2e1daab5b48e service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:53.359886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 706/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:54.241771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a88a-764f-4a32-8762-9c091941b8df None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.242388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a88a-764f-4a32-8762-9c091941b8df None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.242388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a88a-764f-4a32-8762-9c091941b8df None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.243800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:54.250020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6a03-4fa7-4557-8a83-1bdd0260d876 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.250452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6a03-4fa7-4557-8a83-1bdd0260d876 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.250574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6a03-4fa7-4557-8a83-1bdd0260d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.327259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0b6b6a03-4fa7-4557-8a83-1bdd0260d876 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:54.328475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0b6b6a03-4fa7-4557-8a83-1bdd0260d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:54.423953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:54.577662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a88a-764f-4a32-8762-9c091941b8df None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:54.579259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f588a88a-764f-4a32-8762-9c091941b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:54.630383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.727992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a88a-764f-4a32-8762-9c091941b8df None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.848240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.848851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.849164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.849439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.851070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:54.858512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.941555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.943206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb96935-8117-4cdb-8fd5-12c0ef7cb8ef service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.962232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 724/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:55.836096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6c4f2-ce29-4ea8-9903-f580dca82968 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:55.836655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6c4f2-ce29-4ea8-9903-f580dca82968 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:55.836799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6c4f2-ce29-4ea8-9903-f580dca82968 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:55.838086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:55.843912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9003-d448-44cb-b593-8b31d51a51b4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:55.844364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9003-d448-44cb-b593-8b31d51a51b4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:55.844463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9003-d448-44cb-b593-8b31d51a51b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:55.922342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae1c9003-d448-44cb-b593-8b31d51a51b4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:55.923531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae1c9003-d448-44cb-b593-8b31d51a51b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:55.993494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:56.023546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:56.178232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6c4f2-ce29-4ea8-9903-f580dca82968 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:56.179704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-58e6c4f2-ce29-4ea8-9903-f580dca82968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:56.197389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:56.329935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6c4f2-ce29-4ea8-9903-f580dca82968 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:56.536368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:56.568981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:56.569588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.569864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.570135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.571764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:56.672318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:56.673908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f901e9b-a0bc-411a-a186-3426836656f0 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:56.692232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 709/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:57.594920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3111d-8cf0-44e3-aa6a-2114c42b4d8c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.595460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3111d-8cf0-44e3-aa6a-2114c42b4d8c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.595576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3111d-8cf0-44e3-aa6a-2114c42b4d8c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.596918 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:57.602178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb947-0f11-4c5e-93c7-d7fa10ac6c0b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.602627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb947-0f11-4c5e-93c7-d7fa10ac6c0b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.602748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb947-0f11-4c5e-93c7-d7fa10ac6c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.685834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cb3cb947-0f11-4c5e-93c7-d7fa10ac6c0b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:57.687108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cb3cb947-0f11-4c5e-93c7-d7fa10ac6c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:57.727974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.787612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:32:57.954006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3111d-8cf0-44e3-aa6a-2114c42b4d8c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.955572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-33d3111d-8cf0-44e3-aa6a-2114c42b4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:58.102653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3111d-8cf0-44e3-aa6a-2114c42b4d8c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:58.159398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:58.221289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:58.221888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:58.222166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:58.222436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:58.224243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:58.317817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:58.319472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc4e9-c52f-4318-b994-99018bb49fb4 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:58.337542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 727/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:32:59.258663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228d91-96f0-4986-be61-43be360fbe06 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.259299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228d91-96f0-4986-be61-43be360fbe06 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.259299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228d91-96f0-4986-be61-43be360fbe06 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.260572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:59.266033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9143-c82e-41d6-800e-e13339bb4734 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.266491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9143-c82e-41d6-800e-e13339bb4734 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.266614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9143-c82e-41d6-800e-e13339bb4734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.346870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7e1b9143-c82e-41d6-800e-e13339bb4734 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:59.348097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7e1b9143-c82e-41d6-800e-e13339bb4734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:59.350207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:59.445143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:32:59.598353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228d91-96f0-4986-be61-43be360fbe06 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:59.600078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-69228d91-96f0-4986-be61-43be360fbe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:59.748404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228d91-96f0-4986-be61-43be360fbe06 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:59.775542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:59.863610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:59.864137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.864409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.864677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.866346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:59.955656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:59.957295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c084b1-e8a4-41ae-8ad1-2eb7be2a8f4c service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:59.975919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 712/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:01.827044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371266-b2bd-4f9b-905e-b78d2fcb4d34 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:01.827671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371266-b2bd-4f9b-905e-b78d2fcb4d34 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:01.827671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371266-b2bd-4f9b-905e-b78d2fcb4d34 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:01.828933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:01.834630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c93f-bf98-4b91-8348-7f3a88cfc90a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:01.835122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c93f-bf98-4b91-8348-7f3a88cfc90a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:01.835228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c93f-bf98-4b91-8348-7f3a88cfc90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:01.876790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:01.902278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-31b6c93f-bf98-4b91-8348-7f3a88cfc90a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:01.903529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-31b6c93f-bf98-4b91-8348-7f3a88cfc90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:02.000395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:02.283678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f371266-b2bd-4f9b-905e-b78d2fcb4d34 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:02.285206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5f371266-b2bd-4f9b-905e-b78d2fcb4d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:02.398915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f371266-b2bd-4f9b-905e-b78d2fcb4d34 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:02.431277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:02.473988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:02.474587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:02.474890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:02.475159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:02.476849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:02.595317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:02.596819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10a06-2d79-4b0d-822a-397e255a6cc6 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:02.617026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 730/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:04.696044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5ac6-03bf-4da3-b969-cf19fabfc671 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.696613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5ac6-03bf-4da3-b969-cf19fabfc671 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.696613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5ac6-03bf-4da3-b969-cf19fabfc671 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.698010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:04.704683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767346-16dc-4f56-b081-eca903c4e661 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.705153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767346-16dc-4f56-b081-eca903c4e661 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.705268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767346-16dc-4f56-b081-eca903c4e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.775190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ef767346-16dc-4f56-b081-eca903c4e661 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:04.776420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ef767346-16dc-4f56-b081-eca903c4e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:04.790338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.883507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:05.175628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5ac6-03bf-4da3-b969-cf19fabfc671 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.177179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-12fa5ac6-03bf-4da3-b969-cf19fabfc671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:05.282263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5ac6-03bf-4da3-b969-cf19fabfc671 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.294215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.356880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.357693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.357983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.358259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.359887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:05.474020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.475491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d0a95-a6a4-41c8-b188-230b92090292 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.493346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 715/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:07.816863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f598b9-1dd0-499a-ad15-d157ef376672 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.817433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f598b9-1dd0-499a-ad15-d157ef376672 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.817433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f598b9-1dd0-499a-ad15-d157ef376672 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.818940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:07.824493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7a0d1-67b6-4e73-8709-462b663be8c5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.824922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7a0d1-67b6-4e73-8709-462b663be8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.825024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7a0d1-67b6-4e73-8709-462b663be8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.875038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:07.894032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e9e7a0d1-67b6-4e73-8709-462b663be8c5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:07.895283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e9e7a0d1-67b6-4e73-8709-462b663be8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:07.999773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:08.306604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f598b9-1dd0-499a-ad15-d157ef376672 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:08.308167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-80f598b9-1dd0-499a-ad15-d157ef376672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:08.428270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f598b9-1dd0-499a-ad15-d157ef376672 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:08.468317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:08.502771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:08.503417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:08.503699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:08.503987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:08.506272 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:08.617727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:08.619259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c3bb5-d10b-444a-a432-560cd29e8ed9 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:08.642985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 733/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:10.735283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237dda-27fd-4bac-9e70-a3f3f03e70e4 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.735825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237dda-27fd-4bac-9e70-a3f3f03e70e4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.735825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237dda-27fd-4bac-9e70-a3f3f03e70e4 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.737149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:10.742662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b4c-b70a-4fb7-97e2-bf9195fcd904 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.743106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b4c-b70a-4fb7-97e2-bf9195fcd904 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.743236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b4c-b70a-4fb7-97e2-bf9195fcd904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.812781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-29386b4c-b70a-4fb7-97e2-bf9195fcd904 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:10.813915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-29386b4c-b70a-4fb7-97e2-bf9195fcd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:10.834389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.913702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:11.204449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237dda-27fd-4bac-9e70-a3f3f03e70e4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.205996 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b7237dda-27fd-4bac-9e70-a3f3f03e70e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:11.310804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237dda-27fd-4bac-9e70-a3f3f03e70e4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.331903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:11.385492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.386107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.386388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.386669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.388842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:11.498978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.500411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0dadf-cabc-4485-acfc-c41b3a71498d service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.521486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 718/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:13.559714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4598f-2534-48dd-a1d5-6ff99a103106 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.560352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4598f-2534-48dd-a1d5-6ff99a103106 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.560352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4598f-2534-48dd-a1d5-6ff99a103106 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.561855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:13.567502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63417d-24d5-47ed-b88c-f5fc97127e39 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.567920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63417d-24d5-47ed-b88c-f5fc97127e39 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.568024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63417d-24d5-47ed-b88c-f5fc97127e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.632879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.635515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0c63417d-24d5-47ed-b88c-f5fc97127e39 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:13.636761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0c63417d-24d5-47ed-b88c-f5fc97127e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:13.738380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:33:14.036410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4598f-2534-48dd-a1d5-6ff99a103106 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.037948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d3c4598f-2534-48dd-a1d5-6ff99a103106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:14.144485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4598f-2534-48dd-a1d5-6ff99a103106 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.196319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.223954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.224571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.225056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.225375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.227535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:14.336537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.337941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873d6b7-db6a-4bec-8d9a-9d4ed930c542 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.356115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 736/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:16.378253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe13b33-ac28-4af0-873f-6dc226f24381 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.378833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe13b33-ac28-4af0-873f-6dc226f24381 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.378833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe13b33-ac28-4af0-873f-6dc226f24381 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.380238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:16.385827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f411c8-06f7-4584-a36b-4f42a34c1bec None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.386272 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f411c8-06f7-4584-a36b-4f42a34c1bec None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.386371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f411c8-06f7-4584-a36b-4f42a34c1bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.461415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-73f411c8-06f7-4584-a36b-4f42a34c1bec None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:16.462676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-73f411c8-06f7-4584-a36b-4f42a34c1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:16.493016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:16.562450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:16.876334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe13b33-ac28-4af0-873f-6dc226f24381 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:16.877919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3fe13b33-ac28-4af0-873f-6dc226f24381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:16.984947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe13b33-ac28-4af0-873f-6dc226f24381 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:17.014814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:17.061583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:17.062188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:17.062465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:17.062769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:17.064410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:17.178304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:17.179674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d2eee-728d-4db6-bff5-11fe71b51192 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:17.198857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 721/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:19.206821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974bb1-6278-4900-b99b-57ef0c26fe8f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.207394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974bb1-6278-4900-b99b-57ef0c26fe8f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.207394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974bb1-6278-4900-b99b-57ef0c26fe8f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.208703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:19.214033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe1ad8-114e-435f-ba50-37b507149ebb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.214438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe1ad8-114e-435f-ba50-37b507149ebb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.214585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe1ad8-114e-435f-ba50-37b507149ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.280557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e0fe1ad8-114e-435f-ba50-37b507149ebb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:19.281818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e0fe1ad8-114e-435f-ba50-37b507149ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:19.290319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:19.379681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:19.676727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974bb1-6278-4900-b99b-57ef0c26fe8f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.676727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04974bb1-6278-4900-b99b-57ef0c26fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:19.781293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974bb1-6278-4900-b99b-57ef0c26fe8f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:19.839972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:19.860199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:19.860726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.861002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.861268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.862895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:19.973383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:19.974857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0aea-01a2-42dc-b7e2-9adad13dbd42 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:19.992979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 739/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:21.993484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53c4d-4c58-4eec-841c-05d331f0b234 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:21.994084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53c4d-4c58-4eec-841c-05d331f0b234 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:21.994084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53c4d-4c58-4eec-841c-05d331f0b234 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:21.995408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:22.001152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f460c-909e-4c48-b46a-f08816fc78a8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.001586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f460c-909e-4c48-b46a-f08816fc78a8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.001695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f460c-909e-4c48-b46a-f08816fc78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.069381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-290f460c-909e-4c48-b46a-f08816fc78a8 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:22.070590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-290f460c-909e-4c48-b46a-f08816fc78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:22.229855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:22.291698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:22.581485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df53c4d-4c58-4eec-841c-05d331f0b234 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:22.583260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4df53c4d-4c58-4eec-841c-05d331f0b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:22.691677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df53c4d-4c58-4eec-841c-05d331f0b234 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:22.729760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:22.768679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:22.769297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.769575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.770501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.772183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:22.881506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:22.882872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5c8c4-f875-4bcd-b8df-326303351525 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:22.902292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 724/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:25.028299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce60bb-425e-4056-8df1-0054353e660e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.028871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce60bb-425e-4056-8df1-0054353e660e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.028871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce60bb-425e-4056-8df1-0054353e660e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.030812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:25.037508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48dc35-e23c-4e4d-a8e8-574ea558c3b9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.037989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48dc35-e23c-4e4d-a8e8-574ea558c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.038092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48dc35-e23c-4e4d-a8e8-574ea558c3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.106038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1b48dc35-e23c-4e4d-a8e8-574ea558c3b9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:25.107335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1b48dc35-e23c-4e4d-a8e8-574ea558c3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:25.125739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.207930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:25.506534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce60bb-425e-4056-8df1-0054353e660e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.508111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a2ce60bb-425e-4056-8df1-0054353e660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:25.615269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce60bb-425e-4056-8df1-0054353e660e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.683925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.691311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.691917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.692192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.692460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.694058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:25.804281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.805680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ddcbc-40a7-4cbf-a342-b28730818dc3 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.825732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 742/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:27.807747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93dfd6-6cb8-4bd7-b141-2e2abc8282f4 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.808316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93dfd6-6cb8-4bd7-b141-2e2abc8282f4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.808316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93dfd6-6cb8-4bd7-b141-2e2abc8282f4 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.809684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:27.815615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147845-4986-4697-b69b-1d9c754d0d7d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.816105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147845-4986-4697-b69b-1d9c754d0d7d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.816227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147845-4986-4697-b69b-1d9c754d0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.883252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e3147845-4986-4697-b69b-1d9c754d0d7d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:27.884374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e3147845-4986-4697-b69b-1d9c754d0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:27.939974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:27.989781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:28.277699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93dfd6-6cb8-4bd7-b141-2e2abc8282f4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:28.279564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fb93dfd6-6cb8-4bd7-b141-2e2abc8282f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:28.384579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93dfd6-6cb8-4bd7-b141-2e2abc8282f4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:28.433052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:28.459362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:28.459970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.460249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.460519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.462125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:28.572926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:28.574324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a814c4-637b-462a-8652-7547b64a6863 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:28.594191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 727/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:37.988040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=22 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.591781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=66 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.649334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfee81-83b5-4e22-bc58-61bc20610dbf None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.649906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfee81-83b5-4e22-bc58-61bc20610dbf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.649906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfee81-83b5-4e22-bc58-61bc20610dbf None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.651243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 744/1471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:48.656711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879c75-ce5a-48fb-9d15-02657259c5ed None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.657128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879c75-ce5a-48fb-9d15-02657259c5ed None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.657251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879c75-ce5a-48fb-9d15-02657259c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.735150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-06879c75-ce5a-48fb-9d15-02657259c5ed None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:48.736724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-06879c75-ce5a-48fb-9d15-02657259c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:48.842626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 728/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:49.208440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df028-6213-43f9-91eb-1300cce9d40a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.208747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df028-6213-43f9-91eb-1300cce9d40a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.209020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df028-6213-43f9-91eb-1300cce9d40a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.210373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 745/1473] 10.222.0.27 () {54 vars in 967 bytes} [Wed Aug 24 05:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:49.216174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5f2d-6927-4155-bc12-35075ba1fcbc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.216463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5f2d-6927-4155-bc12-35075ba1fcbc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.216738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5f2d-6927-4155-bc12-35075ba1fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.297660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5b6f5f2d-6927-4155-bc12-35075ba1fcbc None None] MFA Rules not processed for user `68071674452b42839ffac496a902737d`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:49.298990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5b6f5f2d-6927-4155-bc12-35075ba1fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:49.320302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.383783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 729/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Wed Aug 24 05:33:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:49.392529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df028-6213-43f9-91eb-1300cce9d40a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.394315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-599df028-6213-43f9-91eb-1300cce9d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:49.501977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df028-6213-43f9-91eb-1300cce9d40a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.578637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.579276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.579549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.579821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.581439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:49.639339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.694367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.695840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8444-372b-48c9-a8ba-2f95c4c71c24 service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.714131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 746/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:51.740778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71faa-e4d2-47c6-b905-c653df546e68 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.741363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71faa-e4d2-47c6-b905-c653df546e68 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.741363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71faa-e4d2-47c6-b905-c653df546e68 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.742667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 730/1476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:51.748190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388626b5-d9a9-434f-9619-d8927414a84c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.748653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388626b5-d9a9-434f-9619-d8927414a84c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.748753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388626b5-d9a9-434f-9619-d8927414a84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.821558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-388626b5-d9a9-434f-9619-d8927414a84c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:51.822933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-388626b5-d9a9-434f-9619-d8927414a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:51.925841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 747/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:52.218233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71faa-e4d2-47c6-b905-c653df546e68 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:52.219924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b3e71faa-e4d2-47c6-b905-c653df546e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:52.349766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71faa-e4d2-47c6-b905-c653df546e68 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:52.401899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:52.448927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:52.449622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.449930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.450226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.451038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:52.454071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:33:52.454071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:33:52.454071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:33:52.455616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4c377-20b8-438e-aa2c-696aa6722490 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.496860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 731/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:52 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:33:54.436262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8088e-c07c-488f-a596-40e15d3ec588 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.436900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8088e-c07c-488f-a596-40e15d3ec588 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.436900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8088e-c07c-488f-a596-40e15d3ec588 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.438133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 748/1479] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:54.443714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44cf1-3199-400d-8399-9ad286e293aa None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.444184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44cf1-3199-400d-8399-9ad286e293aa None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.444294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44cf1-3199-400d-8399-9ad286e293aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.511292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-20b44cf1-3199-400d-8399-9ad286e293aa None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:54.513238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-20b44cf1-3199-400d-8399-9ad286e293aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:54.612470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 732/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:54.928127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8088e-c07c-488f-a596-40e15d3ec588 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.929662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-90b8088e-c07c-488f-a596-40e15d3ec588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:54.940272 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.085908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8088e-c07c-488f-a596-40e15d3ec588 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.173859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.208294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.208972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.209279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.209554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.211343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:55.305546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.307240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b464fbd-c00e-4063-bcef-3b7d838f7dfb service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.325336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 749/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:33:57.581657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5472b4-bd29-40c5-a84d-03bc81080e76 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.582208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5472b4-bd29-40c5-a84d-03bc81080e76 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.582208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5472b4-bd29-40c5-a84d-03bc81080e76 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.583599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 733/1482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:57.589136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9da22-d07c-4abe-a54a-c8415178c0c7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.589716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9da22-d07c-4abe-a54a-c8415178c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.589716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9da22-d07c-4abe-a54a-c8415178c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.662644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-36e9da22-d07c-4abe-a54a-c8415178c0c7 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:57.663903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-36e9da22-d07c-4abe-a54a-c8415178c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:57.712034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.761777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 750/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:33:58.075550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5472b4-bd29-40c5-a84d-03bc81080e76 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.077132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-af5472b4-bd29-40c5-a84d-03bc81080e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:58.100578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.184805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5472b4-bd29-40c5-a84d-03bc81080e76 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.260894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.261502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.262439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.263041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.264629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:58.346967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.382003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.383474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69061a-494f-430c-8e51-5326553fb650 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.403473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 734/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:34:00.517190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757bb5-02c1-4689-87ff-f6319c40c175 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.517780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757bb5-02c1-4689-87ff-f6319c40c175 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.517780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757bb5-02c1-4689-87ff-f6319c40c175 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.519207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 751/1485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:00.524561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49ec34-497d-4ba6-8c11-4a3abca82972 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.524976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49ec34-497d-4ba6-8c11-4a3abca82972 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.525119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49ec34-497d-4ba6-8c11-4a3abca82972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.593134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ef49ec34-497d-4ba6-8c11-4a3abca82972 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:00.594375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ef49ec34-497d-4ba6-8c11-4a3abca82972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:00.698405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 735/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:34:00.993671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4757bb5-02c1-4689-87ff-f6319c40c175 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.995286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f4757bb5-02c1-4689-87ff-f6319c40c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:01.113514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4757bb5-02c1-4689-87ff-f6319c40c175 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.188032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.189730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.190334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.190614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.190916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.192524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:01.303479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.304833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cece8c-3bfd-4e12-9bba-b4d28b8fbebe service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.323723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 752/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:34:03.521667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8dbd3-e696-408b-93cc-5c68a8674da0 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.522249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8dbd3-e696-408b-93cc-5c68a8674da0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.522249 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8dbd3-e696-408b-93cc-5c68a8674da0 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.523645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 736/1488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:03.529405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a365471-0a93-41ad-b6ff-56b1234c7cf4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.529860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a365471-0a93-41ad-b6ff-56b1234c7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.529969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a365471-0a93-41ad-b6ff-56b1234c7cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.596185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5a365471-0a93-41ad-b6ff-56b1234c7cf4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:03.597397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5a365471-0a93-41ad-b6ff-56b1234c7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:03.655047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:03.698738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 753/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:34:03.988605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8dbd3-e696-408b-93cc-5c68a8674da0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:03.990278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cdc8dbd3-e696-408b-93cc-5c68a8674da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:04.028850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:04.097947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8dbd3-e696-408b-93cc-5c68a8674da0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:04.172986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:04.173631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:04.173944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:04.174219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:04.175999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:04.258147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:04.287443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:04.288882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05449511-97a9-4f0b-a637-a850f1e91c8b service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:04.310745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 737/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:34:06.753809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f8d8-a6f7-4e5f-9e32-782669bed0ac None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.754354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f8d8-a6f7-4e5f-9e32-782669bed0ac None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.754474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f8d8-a6f7-4e5f-9e32-782669bed0ac None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.755962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 754/1491] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 05:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:06.761618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e72b0-af25-4622-9354-3f231f5ee786 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.762125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e72b0-af25-4622-9354-3f231f5ee786 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.762232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e72b0-af25-4622-9354-3f231f5ee786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.830496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-228e72b0-af25-4622-9354-3f231f5ee786 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:06.831749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-228e72b0-af25-4622-9354-3f231f5ee786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:06.930860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 738/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:34:07.223228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f8d8-a6f7-4e5f-9e32-782669bed0ac None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.224779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75f8f8d8-a6f7-4e5f-9e32-782669bed0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:07.332376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f8d8-a6f7-4e5f-9e32-782669bed0ac None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.408347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.408946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.409225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.409491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.411141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:07.420364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.521090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.522453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a647b8-1718-4530-b4e7-4cb38c1850f0 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.540734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 755/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:34:16.929008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=82 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:17.538459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=50 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:32.459087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:32.459714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:32.459714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:32.536010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:32.537208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:32.637295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 739/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:35:32.646491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:32.647032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:32.647159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:32.729663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:32.730907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:32.831477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 756/1495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:35:32.844303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:32.845577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:32.857560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b0df7-1b6f-4be1-bc98-de8a7dabc513 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:32.921618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:32.955380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:32.955992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:32.956269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:32.956540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:32.957195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:32.957779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:32.959097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:32.959097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:35:32.959097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:35:32.960302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:32.972643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 740/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:32.981075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:32.990415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7550ec-9348-4862-bcf3-cc0f170fa2ce None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:33.053671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:33.088432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:33.089163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:33.089744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:33.090017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:33.090674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:33.093134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:33.093134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:35:33.093134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:35:33.094327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:33.202953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 757/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:35:32 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:35:33.207351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:33.208961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:33.243283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5554fd-1946-4c17-b590-8d01541ce401 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:33.336877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:33.337484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:33.337765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:33.338039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:33.338673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:33.339715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:33.339715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:35:33.339715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:35:33.341815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:33.438056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 741/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:35:33 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:35:33.442949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:33.444472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:33.508901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5414-2c0c-405e-b486-a557bc0629c3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:33.608364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:33.619728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:33.620312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:33.620591 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:33.620864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:33.621534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:33.623133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:33.623133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:35:33.623133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:35:33.624042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:33.640949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 758/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:35:33.642528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:33.644103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:33.656199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9d77-896d-4a9a-9c2f-6ecd58365ae4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:33.682087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:33.753114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:33.753723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:33.754000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:33.754272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:33.754943 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:33.755956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:33.755956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:35:33.755956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:35:33.756848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13649c06-561e-46fb-84b4-0fd80e68514b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:33.770177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 742/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:35:33.774950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:33.776831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:33.813013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145bb81-2d46-484f-add5-6dcb76b0ed5d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:33.917448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:33.920064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:33.920340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:33.920614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] PATH_INFO: `/v3/projects/f386c6aaae2f4b9aa09aad3c12997322/users/312ffd5976a742d88c4a57bd2a07f589/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:33.944831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=f386c6aaae2f4b9aa09aad3c12997322, user_id=312ffd5976a742d88c4a57bd2a07f589, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:33.946250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:33.946250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:35:33.946250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:35:33.947834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604835-4221-4773-9c4c-5d132eb77ead admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:34.092449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 759/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:35:33 2022] PUT /identity/v3/projects/f386c6aaae2f4b9aa09aad3c12997322/users/312ffd5976a742d88c4a57bd2a07f589/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:35:34.104788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02fcb-0e9f-4429-a3fe-c39338737594 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:34.105084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02fcb-0e9f-4429-a3fe-c39338737594 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:34.105451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02fcb-0e9f-4429-a3fe-c39338737594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:34.172822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a9f02fcb-0e9f-4429-a3fe-c39338737594 None None] MFA Rules not processed for user `312ffd5976a742d88c4a57bd2a07f589`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:34.174057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a9f02fcb-0e9f-4429-a3fe-c39338737594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:34.260427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 743/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:35:34.275381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946338-ab3d-4cb5-ba65-927d9f2a9d48 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:34.275671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946338-ab3d-4cb5-ba65-927d9f2a9d48 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:34.275948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946338-ab3d-4cb5-ba65-927d9f2a9d48 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:34.277322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 760/1503] 10.222.0.27 () {54 vars in 964 bytes} [Wed Aug 24 05:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:34.284646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf2aa-48f6-465a-879b-a46b3d804751 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:34.284932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf2aa-48f6-465a-879b-a46b3d804751 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:34.285211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf2aa-48f6-465a-879b-a46b3d804751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:34.318838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:34.365154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ff3bf2aa-48f6-465a-879b-a46b3d804751 None None] MFA Rules not processed for user `dddbf44c00e7411db8084d75fee531e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:34.366274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ff3bf2aa-48f6-465a-879b-a46b3d804751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:34.444476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 744/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Aug 24 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:35:34.452885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946338-ab3d-4cb5-ba65-927d9f2a9d48 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:34.454421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-12946338-ab3d-4cb5-ba65-927d9f2a9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:34.515251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:34.574265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946338-ab3d-4cb5-ba65-927d9f2a9d48 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:34.652300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:34.652908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:34.653384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:34.653755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:34.656109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:34.764364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:34.765801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:34.769415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:34.784612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 761/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:35:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:35:34.829950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37acb7-379d-49df-981f-994bef860125 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:34.830457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37acb7-379d-49df-981f-994bef860125 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:34.830551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37acb7-379d-49df-981f-994bef860125 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:34.831764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 745/1506] 10.222.0.27 () {52 vars in 830 bytes} [Wed Aug 24 05:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:34.836258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:34.838238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:34.945318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8fe4-0752-47d7-b0ba-a6be8ab93c22 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:35.048783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:35.049503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:35.049771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:35.050037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] PATH_INFO: `/v3/users/312ffd5976a742d88c4a57bd2a07f589` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:35.065184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312ffd5976a742d88c4a57bd2a07f589)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:35.066666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:35.066666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:35:35.066666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:35:35.068060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:35.081179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:35.323534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312ffd5976a742d88c4a57bd2a07f589'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:35.324250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312ffd5976a742d88c4a57bd2a07f589'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:35.355888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312ffd5976a742d88c4a57bd2a07f589'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:35.426780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312ffd5976a742d88c4a57bd2a07f589'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:35.427160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312ffd5976a742d88c4a57bd2a07f589'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:35.447902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 762/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:35:34 2022] DELETE /identity/v3/users/312ffd5976a742d88c4a57bd2a07f589 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:35:35.453797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:35.454085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:35.454359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:35.515634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:35.516865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:35.597371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:35.610277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 746/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:35:35.621830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:35.623721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:35.735857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf353ca-2a99-4776-b85e-c7e7f49854e8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:35.809393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:35.837735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:35.839029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:35.839029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:35.839029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:35.840551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:35.979428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:35.980879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6041e96-12e9-4434-9b8a-a87a53b5bd2b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:36.002107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 763/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:35:36.549817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:36.551218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:36.563831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710fe7a-a4d6-49fe-825b-e3f16e1c4392 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:36.679912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:36.680553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:36.680836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:36.681120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] PATH_INFO: `/v3/projects/f386c6aaae2f4b9aa09aad3c12997322` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:36.692076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f386c6aaae2f4b9aa09aad3c12997322)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:36.693102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:35:36.693102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:35:36.693102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:35:36.694300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:36.814521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f386c6aaae2f4b9aa09aad3c12997322', 'request_id': 'req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:36.895066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f386c6aaae2f4b9aa09aad3c12997322', 'request_id': 'req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:36.909987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f386c6aaae2f4b9aa09aad3c12997322', 'request_id': 'req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:36.932776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] The token cache is being invalidate because project f386c6aaae2f4b9aa09aad3c12997322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:35:36.933071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:36.933614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ece92c32-5d2d-4c7f-9814-42ae18e72c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:35:36.934995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 747/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:35:36 2022] DELETE /identity/v3/projects/f386c6aaae2f4b9aa09aad3c12997322 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:35:45.999759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=62 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:46.931062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:14.477353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e966-a121-4032-8050-e2c5944f85d0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:14.477991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e966-a121-4032-8050-e2c5944f85d0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:14.477991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e966-a121-4032-8050-e2c5944f85d0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:14.479287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:14.484381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ca38-f189-4e71-8566-d8df0222d9ee None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:14.484863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ca38-f189-4e71-8566-d8df0222d9ee None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:14.485010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ca38-f189-4e71-8566-d8df0222d9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:14.578924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f664ca38-f189-4e71-8566-d8df0222d9ee None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:14.580162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f664ca38-f189-4e71-8566-d8df0222d9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:14.702767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:14.869441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962e966-a121-4032-8050-e2c5944f85d0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:14.874132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0962e966-a121-4032-8050-e2c5944f85d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:14.997830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962e966-a121-4032-8050-e2c5944f85d0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:15.003520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39888791-465b-4212-b510-cfa41e06a36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:15.004131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888791-465b-4212-b510-cfa41e06a36a service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:15.004412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888791-465b-4212-b510-cfa41e06a36a service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:15.004686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888791-465b-4212-b510-cfa41e06a36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:15.014266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39888791-465b-4212-b510-cfa41e06a36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:15.016419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39888791-465b-4212-b510-cfa41e06a36a service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:15.025869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 765/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:15.917238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23e9a-4b09-4fe6-b6c2-333c37dd19a2 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:15.917833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23e9a-4b09-4fe6-b6c2-333c37dd19a2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:15.917833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23e9a-4b09-4fe6-b6c2-333c37dd19a2 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:15.919168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:15.924156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073dc3-e8ee-4a7b-85c9-c8b08a105151 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:15.924644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073dc3-e8ee-4a7b-85c9-c8b08a105151 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:15.924750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073dc3-e8ee-4a7b-85c9-c8b08a105151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:15.945806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-30073dc3-e8ee-4a7b-85c9-c8b08a105151 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:15.947285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-30073dc3-e8ee-4a7b-85c9-c8b08a105151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:15.955276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:16.109739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23e9a-4b09-4fe6-b6c2-333c37dd19a2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:16.124679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23e9a-4b09-4fe6-b6c2-333c37dd19a2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:16.130353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c72cf3-1466-426b-81aa-e5c1c5245059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:16.131071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72cf3-1466-426b-81aa-e5c1c5245059 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:16.131454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72cf3-1466-426b-81aa-e5c1c5245059 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:16.131747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72cf3-1466-426b-81aa-e5c1c5245059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:16.143072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c72cf3-1466-426b-81aa-e5c1c5245059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:16.144993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c72cf3-1466-426b-81aa-e5c1c5245059 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:16.160252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 750/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:16.536790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48940e69-2699-4069-afc9-591c1fd1b209 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:16.537073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48940e69-2699-4069-afc9-591c1fd1b209 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:16.537351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48940e69-2699-4069-afc9-591c1fd1b209 None None] PATH_INFO: `/v3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:16.538787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 767/1517] 10.222.0.59 () {54 vars in 925 bytes} [Wed Aug 24 05:37:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:37:16.546176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98e7b5-0a06-40d3-999c-464ad88a84ff None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:16.546463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98e7b5-0a06-40d3-999c-464ad88a84ff None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:16.546772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98e7b5-0a06-40d3-999c-464ad88a84ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:16.616382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4f98e7b5-0a06-40d3-999c-464ad88a84ff None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:16.618554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4f98e7b5-0a06-40d3-999c-464ad88a84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:16.639636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:16.700597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 751/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 05:37:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:20.927771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59f19-3be6-427e-98f7-475d435a1cc7 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:20.928377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59f19-3be6-427e-98f7-475d435a1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:20.928377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59f19-3be6-427e-98f7-475d435a1cc7 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:20.929743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 768/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Aug 24 05:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:20.935185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498555a-0eed-4a73-8cbe-993a6c3c17da None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:20.935997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498555a-0eed-4a73-8cbe-993a6c3c17da None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:20.935997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498555a-0eed-4a73-8cbe-993a6c3c17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:20.956037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a498555a-0eed-4a73-8cbe-993a6c3c17da None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:20.957283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a498555a-0eed-4a73-8cbe-993a6c3c17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:20.966530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 752/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Aug 24 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:20.974143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59f19-3be6-427e-98f7-475d435a1cc7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:20.989612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59f19-3be6-427e-98f7-475d435a1cc7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:20.995692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc3746-e311-4513-8c89-0145dd2f4b7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:20.996300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc3746-e311-4513-8c89-0145dd2f4b7c service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:20.996579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc3746-e311-4513-8c89-0145dd2f4b7c service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:20.996849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc3746-e311-4513-8c89-0145dd2f4b7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:21.005844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc3746-e311-4513-8c89-0145dd2f4b7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:21.008179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc3746-e311-4513-8c89-0145dd2f4b7c service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:21.019759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 769/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:27.468029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeb9e6-bc86-4bd8-8964-944ac4047022 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:27.468598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeb9e6-bc86-4bd8-8964-944ac4047022 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:27.468598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeb9e6-bc86-4bd8-8964-944ac4047022 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:27.469967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:27.475024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac4f6-bd77-4330-b2cd-336b2d63b299 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:27.476375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac4f6-bd77-4330-b2cd-336b2d63b299 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:27.476375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac4f6-bd77-4330-b2cd-336b2d63b299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:27.496733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-409ac4f6-bd77-4330-b2cd-336b2d63b299 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:27.501309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-409ac4f6-bd77-4330-b2cd-336b2d63b299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:27.506411 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:27.697937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deeb9e6-bc86-4bd8-8964-944ac4047022 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:27.713777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deeb9e6-bc86-4bd8-8964-944ac4047022 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:27.719349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddb917-49e6-460f-a0be-43f99a1ae701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:27.719964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb917-49e6-460f-a0be-43f99a1ae701 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:27.720248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb917-49e6-460f-a0be-43f99a1ae701 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:27.720526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb917-49e6-460f-a0be-43f99a1ae701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:27.729543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb917-49e6-460f-a0be-43f99a1ae701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:27.731188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb917-49e6-460f-a0be-43f99a1ae701 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:27.742167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 754/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:28.584960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cad8b-972b-4cda-9ed5-7be53e4a1be9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:28.585602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cad8b-972b-4cda-9ed5-7be53e4a1be9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:28.585710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cad8b-972b-4cda-9ed5-7be53e4a1be9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:28.587019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:28.592247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e127-a335-460f-8c21-0660737f6799 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:28.592730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e127-a335-460f-8c21-0660737f6799 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:28.592839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e127-a335-460f-8c21-0660737f6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:28.628357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0528e127-a335-460f-8c21-0660737f6799 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:28.629998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0528e127-a335-460f-8c21-0660737f6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:28.639865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:28.801794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cad8b-972b-4cda-9ed5-7be53e4a1be9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:28.816847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cad8b-972b-4cda-9ed5-7be53e4a1be9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:28.822470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52f37-b4fe-4737-a661-2e5ef64b2521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:28.823097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52f37-b4fe-4737-a661-2e5ef64b2521 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:28.823374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52f37-b4fe-4737-a661-2e5ef64b2521 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:28.823644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52f37-b4fe-4737-a661-2e5ef64b2521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:28.832107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52f37-b4fe-4737-a661-2e5ef64b2521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:28.833694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52f37-b4fe-4737-a661-2e5ef64b2521 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:28.844112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 772/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:32.836339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7cbf-001c-4fc7-a81e-91f72a8b959e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:32.836926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7cbf-001c-4fc7-a81e-91f72a8b959e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:32.836926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7cbf-001c-4fc7-a81e-91f72a8b959e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:32.838281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:32.844138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea69e7-59bf-41c4-b19e-ed52ef8fa5f2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:32.844667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea69e7-59bf-41c4-b19e-ed52ef8fa5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:32.844667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea69e7-59bf-41c4-b19e-ed52ef8fa5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:32.866924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1dea69e7-59bf-41c4-b19e-ed52ef8fa5f2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:32.867928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1dea69e7-59bf-41c4-b19e-ed52ef8fa5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:32.876720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:33.180891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7cbf-001c-4fc7-a81e-91f72a8b959e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:33.182667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9c2a7cbf-001c-4fc7-a81e-91f72a8b959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:33.266913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7cbf-001c-4fc7-a81e-91f72a8b959e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:33.270723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ac6c5-e472-4229-b662-c1036ba55174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:33.271416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac6c5-e472-4229-b662-c1036ba55174 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:33.271741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac6c5-e472-4229-b662-c1036ba55174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:33.272156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac6c5-e472-4229-b662-c1036ba55174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:33.282021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ac6c5-e472-4229-b662-c1036ba55174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:33.283571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ac6c5-e472-4229-b662-c1036ba55174 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:33.293614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 757/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:35.254210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2346-c2bb-4669-8fa6-c8f44c75f671 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:35.254814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2346-c2bb-4669-8fa6-c8f44c75f671 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:35.254814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2346-c2bb-4669-8fa6-c8f44c75f671 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:35.256763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:35.262646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe31b-d871-4c06-aefa-46b7277fb66a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:35.263175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe31b-d871-4c06-aefa-46b7277fb66a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:35.263284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe31b-d871-4c06-aefa-46b7277fb66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:35.283330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2eebe31b-d871-4c06-aefa-46b7277fb66a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:35.284467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2eebe31b-d871-4c06-aefa-46b7277fb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:35.292992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:35.593999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2346-c2bb-4669-8fa6-c8f44c75f671 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:35.605941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2346-c2bb-4669-8fa6-c8f44c75f671 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:35.609486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff2df4-d714-43ff-8ba2-22f3c6e2fb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:35.610096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff2df4-d714-43ff-8ba2-22f3c6e2fb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:35.610375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff2df4-d714-43ff-8ba2-22f3c6e2fb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:35.610639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff2df4-d714-43ff-8ba2-22f3c6e2fb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:35.620293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff2df4-d714-43ff-8ba2-22f3c6e2fb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:35.621734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff2df4-d714-43ff-8ba2-22f3c6e2fb8c service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:35.632295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 775/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:37:39.183523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d58a4-02e1-4738-92e0-1cf18fec1d17 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:39.184305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d58a4-02e1-4738-92e0-1cf18fec1d17 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:39.184305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d58a4-02e1-4738-92e0-1cf18fec1d17 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:39.185416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:39.191258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef539a7-0000-48fc-a798-51673c72f350 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:39.191750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef539a7-0000-48fc-a798-51673c72f350 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:39.191920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef539a7-0000-48fc-a798-51673c72f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:39.200637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:39.213751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cef539a7-0000-48fc-a798-51673c72f350 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:39.215004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cef539a7-0000-48fc-a798-51673c72f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:39.223040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:39.804970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d58a4-02e1-4738-92e0-1cf18fec1d17 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:39.806670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ee5d58a4-02e1-4738-92e0-1cf18fec1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:39.875749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:39.889953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d58a4-02e1-4738-92e0-1cf18fec1d17 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:39.893570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e055e-20a6-4e5a-a7c3-3c7e65e8a4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:39.894183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e055e-20a6-4e5a-a7c3-3c7e65e8a4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:39.894466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e055e-20a6-4e5a-a7c3-3c7e65e8a4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:39.894767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e055e-20a6-4e5a-a7c3-3c7e65e8a4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:39.919926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e055e-20a6-4e5a-a7c3-3c7e65e8a4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:39.921363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e055e-20a6-4e5a-a7c3-3c7e65e8a4e9 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:39.932516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 760/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:41.909130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63b66-4354-447b-a93e-96bf75398fd6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:41.909653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63b66-4354-447b-a93e-96bf75398fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:41.909653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63b66-4354-447b-a93e-96bf75398fd6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:41.910981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:41.916574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2b9b-8ade-4b37-a8b0-9170c2be6176 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:41.917028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2b9b-8ade-4b37-a8b0-9170c2be6176 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:41.917123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2b9b-8ade-4b37-a8b0-9170c2be6176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:41.936038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ee6f2b9b-8ade-4b37-a8b0-9170c2be6176 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:41.937230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ee6f2b9b-8ade-4b37-a8b0-9170c2be6176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:41.945624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:37:42.509290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63b66-4354-447b-a93e-96bf75398fd6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:42.511021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-20b63b66-4354-447b-a93e-96bf75398fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:42.525692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63b66-4354-447b-a93e-96bf75398fd6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:42.529363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf8971-68e4-40c3-b5fd-90a1ef4a1038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:42.529966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf8971-68e4-40c3-b5fd-90a1ef4a1038 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:42.530240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf8971-68e4-40c3-b5fd-90a1ef4a1038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:42.530509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf8971-68e4-40c3-b5fd-90a1ef4a1038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:42.540098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf8971-68e4-40c3-b5fd-90a1ef4a1038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:42.541629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf8971-68e4-40c3-b5fd-90a1ef4a1038 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:42.551269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 778/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:37:51.931059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=11 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:52.547029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.642187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.642187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.642187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.656654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:12.658027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:12.676189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 762/1540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:12.685402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.685981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.685981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.716653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:12.718038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:12.733223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 779/1541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:12.738989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.749320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961f16-0797-4406-8b90-6eb1ba99388b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.759330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.760111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.760397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.760672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.761605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:12.761908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.763548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.780707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 763/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:12.790760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.801098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea8ff5-19f2-48ba-843a-d69d4735c508 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.809692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.810334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.810621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.810903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.811568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.813495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.939201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 780/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/projects => generated 355 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:12.944181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.955611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50d3fb-77e8-4710-92a5-824d084c26a9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.030680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.031350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.031633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.031910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.032714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.035615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.118134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 764/1544] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/users => generated 278 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:13.122718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.136247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efbbe5-14b5-4669-9dab-668152ccc324 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.151840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.152503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.152787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.153061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.153737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.155424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.168133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 781/1545] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:13.172865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.184000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554539-eec7-4abd-97e5-5d3eb7b2014a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.194749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37732f-789a-4a67-97d0-fee82758d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.195319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37732f-789a-4a67-97d0-fee82758d159 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.195603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37732f-789a-4a67-97d0-fee82758d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.195876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37732f-789a-4a67-97d0-fee82758d159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.196532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37732f-789a-4a67-97d0-fee82758d159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.198131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37732f-789a-4a67-97d0-fee82758d159 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.214327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 765/1546] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:13.218841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.230599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14544e-27ff-46f1-91a7-8b090d715873 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.242666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5008455-f3dc-4dfb-babd-059ad1bde928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.243389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5008455-f3dc-4dfb-babd-059ad1bde928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.243694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5008455-f3dc-4dfb-babd-059ad1bde928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.243951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5008455-f3dc-4dfb-babd-059ad1bde928 admin admin] PATH_INFO: `/v3/projects/b89716ad7c56404bbeed7a773239001e/users/5b0d118b333c4f84985ea5d1b2170778/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.266865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5008455-f3dc-4dfb-babd-059ad1bde928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89716ad7c56404bbeed7a773239001e, user_id=5b0d118b333c4f84985ea5d1b2170778, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.270480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5008455-f3dc-4dfb-babd-059ad1bde928 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.343245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f862e7-cc33-43c1-96b3-6074dfe27c74 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.343660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f862e7-cc33-43c1-96b3-6074dfe27c74 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.343807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f862e7-cc33-43c1-96b3-6074dfe27c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.369837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c8f862e7-cc33-43c1-96b3-6074dfe27c74 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:13.371307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c8f862e7-cc33-43c1-96b3-6074dfe27c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:13.384989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 782/1547] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:13 2022] PUT /identity/v3/projects/b89716ad7c56404bbeed7a773239001e/users/5b0d118b333c4f84985ea5d1b2170778/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:13.399123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.399487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.399678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.452534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] MFA Rules not processed for user `5b0d118b333c4f84985ea5d1b2170778`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:13.453721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:13.486986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 766/1548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:13.501413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.501797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.502208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.537212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:13.538455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:13.552255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 767/1549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 05:39:13.558266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.579419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94f57-bb19-4bca-9af1-f593e5e082fb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.585276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.585932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.586219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.586494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.591619 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:13.591959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.593683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.618726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 783/1550] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:13.619330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 768/1551] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:13.622526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.633548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.652604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b108-ebe7-4b32-ba42-0528ba84ab37 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.656193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd76fc-7a0e-4839-9cf9-134888aaab71 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.666630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.667289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.667662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.667941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.668594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.669665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:13.669665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:39:13.669665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:39:13.674182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.682408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.683083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.683363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.683650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.684449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.686542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.827474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 769/1552] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/projects => generated 405 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:13.840250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.841261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 784/1553] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/projects => generated 357 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:13.846542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.868960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.943090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.949816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457244-12c8-480b-ac47-1dfdba4d06db admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.955356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfff9a6-2168-4c2f-8db6-1f91eff46716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.956159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfff9a6-2168-4c2f-8db6-1f91eff46716 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.956159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfff9a6-2168-4c2f-8db6-1f91eff46716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.956523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfff9a6-2168-4c2f-8db6-1f91eff46716 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.956835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1ade0-43f1-455d-b788-6616da2d4948 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.957075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfff9a6-2168-4c2f-8db6-1f91eff46716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.960736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfff9a6-2168-4c2f-8db6-1f91eff46716 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.973472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.974168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.974435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.974723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.975370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.976446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:13.976446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:39:13.976446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:39:13.977797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd6f62-c901-45b4-a2ae-65d4deadecd8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.076823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 770/1554] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:39:14.078166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340d38-ed9c-4328-8bd0-d357283ac425 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.078393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340d38-ed9c-4328-8bd0-d357283ac425 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.078662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340d38-ed9c-4328-8bd0-d357283ac425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.089380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 785/1555] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:39:14.092236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64e1e-39e4-4a95-9a7c-bd5f2e8db2a7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.092236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64e1e-39e4-4a95-9a7c-bd5f2e8db2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.092236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64e1e-39e4-4a95-9a7c-bd5f2e8db2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.103598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-04340d38-ed9c-4328-8bd0-d357283ac425 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.104824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-04340d38-ed9c-4328-8bd0-d357283ac425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.111881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-60f64e1e-39e4-4a95-9a7c-bd5f2e8db2a7 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.113098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-60f64e1e-39e4-4a95-9a7c-bd5f2e8db2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.113214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 771/1556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.114438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7d07-c405-4360-9356-c88b222ea499 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.114628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7d07-c405-4360-9356-c88b222ea499 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.115000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7d07-c405-4360-9356-c88b222ea499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.122428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 786/1557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.123895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4bafe-40ea-4fc2-b66e-b3d0e22c3e93 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.124188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4bafe-40ea-4fc2-b66e-b3d0e22c3e93 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.124459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4bafe-40ea-4fc2-b66e-b3d0e22c3e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.144179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-402d7d07-c405-4360-9356-c88b222ea499 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.145435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cfd4bafe-40ea-4fc2-b66e-b3d0e22c3e93 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.145763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-402d7d07-c405-4360-9356-c88b222ea499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.146597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cfd4bafe-40ea-4fc2-b66e-b3d0e22c3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.154424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 772/1558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.154710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 787/1559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.156040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544567f8-bb13-416f-bd55-0712632458cb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.156329 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544567f8-bb13-416f-bd55-0712632458cb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.156601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544567f8-bb13-416f-bd55-0712632458cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.160824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.161742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.162176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.176963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-544567f8-bb13-416f-bd55-0712632458cb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.178234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-544567f8-bb13-416f-bd55-0712632458cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.182421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.183670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.186409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 788/1560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.187311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544567f8-bb13-416f-bd55-0712632458cb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.194844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 773/1561] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.195579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.203992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544567f8-bb13-416f-bd55-0712632458cb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.204907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1505e3-c96d-48a6-868f-68c2f5d4bc9b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.209578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220106e7-11a2-4c7f-97df-ac3343548e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.210194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220106e7-11a2-4c7f-97df-ac3343548e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.210373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25069-8464-4b82-b6f7-47391ca5fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.210590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220106e7-11a2-4c7f-97df-ac3343548e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.210784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220106e7-11a2-4c7f-97df-ac3343548e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.210940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25069-8464-4b82-b6f7-47391ca5fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.211137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25069-8464-4b82-b6f7-47391ca5fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.211407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25069-8464-4b82-b6f7-47391ca5fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.211583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220106e7-11a2-4c7f-97df-ac3343548e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.212060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25069-8464-4b82-b6f7-47391ca5fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.213035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220106e7-11a2-4c7f-97df-ac3343548e1e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.213612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25069-8464-4b82-b6f7-47391ca5fd51 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.224436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 789/1562] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:14.224962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 774/1563] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:14.225948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eb3c7-64dc-4040-b3c4-517b247f4ae5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.226227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631de118-707d-41a5-a362-3d141ea7bf3a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.226349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eb3c7-64dc-4040-b3c4-517b247f4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.226513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631de118-707d-41a5-a362-3d141ea7bf3a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.226760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eb3c7-64dc-4040-b3c4-517b247f4ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.226878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631de118-707d-41a5-a362-3d141ea7bf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.247362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-631de118-707d-41a5-a362-3d141ea7bf3a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.248259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cc0eb3c7-64dc-4040-b3c4-517b247f4ae5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.248587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-631de118-707d-41a5-a362-3d141ea7bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.249452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cc0eb3c7-64dc-4040-b3c4-517b247f4ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.257837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 775/1564] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.258056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 790/1565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.259187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80982cd-5c95-4a61-9d35-7d5213b4f7b5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.259434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52fc4-66de-4651-8074-52466b18a1d1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.259540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80982cd-5c95-4a61-9d35-7d5213b4f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.259724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52fc4-66de-4651-8074-52466b18a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.259835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80982cd-5c95-4a61-9d35-7d5213b4f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.259995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52fc4-66de-4651-8074-52466b18a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.279895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-93c52fc4-66de-4651-8074-52466b18a1d1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.281107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-93c52fc4-66de-4651-8074-52466b18a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.281490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a80982cd-5c95-4a61-9d35-7d5213b4f7b5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.282652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a80982cd-5c95-4a61-9d35-7d5213b4f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.288962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 791/1566] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.290327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.290616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.290919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.294279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 776/1567] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.295563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.295837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.296112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.312265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.313482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.316790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:14.317948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:14.322274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 792/1568] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.323189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.326349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 777/1569] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:14.327236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.335513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888cc74-4e99-4d1c-bab4-08490d17008a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.336829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7cd02-1af1-43e1-96e2-af00e1825686 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.340205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.340812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.341089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.341359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.342005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.342200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.343011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.343385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.343658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.343838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] PATH_INFO: `/v3/projects/be304d63099445948840e17fda7765a0/users/889b720e50bc42d19bcd6f44638b2cfe/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.354153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 793/1570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:14.355094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.364542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be304d63099445948840e17fda7765a0, user_id=889b720e50bc42d19bcd6f44638b2cfe, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.365688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:14.365688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:39:14.365688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:39:14.366335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e7526-26b0-4787-96d8-ad96c37b61fc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.368104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.371907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.372592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.372957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.373949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.374650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.375119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.376204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:14.376204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:39:14.376204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:39:14.377830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.390614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 794/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.391476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.401241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41519b-6889-4c31-b483-bd2a053e2868 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.405838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.406460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.406766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.407037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.407679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.408048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.409578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.421710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 795/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.422606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.434774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9ba6-7100-492d-8f3c-8483e0d43d48 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.440086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.440708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.440990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.441264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.441919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.442250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.443901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.459516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 796/1573] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.460431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.463936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 778/1574] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:14 2022] PUT /identity/v3/projects/be304d63099445948840e17fda7765a0/users/889b720e50bc42d19bcd6f44638b2cfe/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:14.463936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.476182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245c98e-e85a-44ad-b592-e620817206a6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.532621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220b414-80a5-4e29-b2cd-5199bbddc2a0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.536611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.537230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.537399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.537549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.537857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.538016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.538283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.538435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.538551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.538768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.539214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.539522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.540394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.541144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.553747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 797/1576] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.553961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 779/1576] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.554445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.554552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.566101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6fd9b-1d54-43c2-8db9-f8dd22a2c976 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.571057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.571672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.571956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.572199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d444-cbda-4f28-b967-59f877a9e224 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.572314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.572876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.573186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.574821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.577085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.577697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.577979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.578256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] PATH_INFO: `/v3/projects/bdd5e9c92dd440429d3faf3eac3684ac/users/d688cd69ca334bb7a47d7cd21ff51110/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.587850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 798/1577] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.588607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.596864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd5e9c92dd440429d3faf3eac3684ac, user_id=d688cd69ca334bb7a47d7cd21ff51110, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.599774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.600104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c07058-e304-471b-8c66-5a6a7d1d5135 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.605913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.606578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.606873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.607142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.607777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.609703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.694757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 780/1578] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:14 2022] PUT /identity/v3/projects/bdd5e9c92dd440429d3faf3eac3684ac/users/d688cd69ca334bb7a47d7cd21ff51110/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:14.695690 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.700002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.719304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 799/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:14.719304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.727290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.760389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef415c-d0db-4e63-ab31-86223b6f59d6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.788034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3b48b-89f5-498b-bcc2-9d349306d945 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.793793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.795981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.795981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.795981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.795981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.797327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.812343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 800/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:14.812343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.821140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150abee1-ff2b-4e9b-9a23-de97da5791fc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.822979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.823619 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.823901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.824175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.824808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.825872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.826470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.826773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.826953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.827062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.827662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.829564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.941359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 781/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:14.942101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.968519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 801/1582] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:14.968519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.008262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02cc81-6fa0-4277-b6d7-b66c43b17d7e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.034194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043cdb5-8680-4c60-b148-c360e037177a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.041435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.041435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.041435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.041435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.041939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.043245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.056040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.073387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5be045-09b0-463c-b8e8-b187ebe2b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.074007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5be045-09b0-463c-b8e8-b187ebe2b5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.074289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5be045-09b0-463c-b8e8-b187ebe2b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.074561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5be045-09b0-463c-b8e8-b187ebe2b5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.075227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5be045-09b0-463c-b8e8-b187ebe2b5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.077280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5be045-09b0-463c-b8e8-b187ebe2b5fc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.130149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 802/1583] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.131170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.152153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 782/1584] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:14 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.153486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.153756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.154018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.185099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] MFA Rules not processed for user `d688cd69ca334bb7a47d7cd21ff51110`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:15.186346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:15.202331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890188-bd9b-4863-85eb-089bd9ca1c52 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.208131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.254685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 783/1585] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:15.255549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.271903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.272525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.272809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.273357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.273717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.275674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.321819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0de7e-2e20-4174-b638-7a9533da3b19 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.326771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.327384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.327660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.327932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.328553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.331415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.409875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 803/1586] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/projects => generated 405 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.411025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.431909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 784/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.433958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.444279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08d85-f463-49c6-94ce-0f8a7adfcdfc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.485761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25c416-d029-4877-8f1b-4d929ec1eda8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.490825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.491490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.491772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.492048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] PATH_INFO: `/v3/projects/be304d63099445948840e17fda7765a0/users/889b720e50bc42d19bcd6f44638b2cfe/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.493974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be304d63099445948840e17fda7765a0, user_id=889b720e50bc42d19bcd6f44638b2cfe, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.495182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.496721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.508170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 804/1588] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:15 2022] PUT /identity/v3/projects/be304d63099445948840e17fda7765a0/users/889b720e50bc42d19bcd6f44638b2cfe/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:15.509062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.509598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.510408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.510711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.511255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.511882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.513802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.581584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797362-942f-468f-861b-37f8d45585d5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.586266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.586963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.587250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.587522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.588201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.590151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.601026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 785/1589] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.604974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.615418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2146a2-0814-4026-a6a9-a4b71df2f895 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.620738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.621426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.621623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.621891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.622514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.624570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.668184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 805/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.668184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.676008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7fd1-9d99-4c39-b137-2465a66e2b9a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.680585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.681166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.681444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.681738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.682350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.684358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.722321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 786/1591] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.723374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.733143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f8c14-8614-4bea-a7c6-69b091d299e0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.738536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.739110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.739391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.739688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.740306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.742185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.786121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.791255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 806/1592] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.792035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.802434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d823-4abb-446e-a0b8-e558eaa6258c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.807144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab277db-d13e-463b-97a5-1a4e76bbeaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.807741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab277db-d13e-463b-97a5-1a4e76bbeaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.808014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab277db-d13e-463b-97a5-1a4e76bbeaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.808284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab277db-d13e-463b-97a5-1a4e76bbeaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.808904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab277db-d13e-463b-97a5-1a4e76bbeaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.810830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab277db-d13e-463b-97a5-1a4e76bbeaa3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.821325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 787/1593] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.822420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.883062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 807/1594] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:15.884757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5dea9-bb54-4cee-92a6-c438da8bd204 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.888149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.888446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.888720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.890316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.890985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.891261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.891543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.892175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.894246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.904989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 788/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:15.910686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.918711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] MFA Rules not processed for user `889b720e50bc42d19bcd6f44638b2cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:15.919273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90874f6d-59d3-4c48-9d65-23976517229a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.920134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:15.925171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.925792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.926077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.926349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.927053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.928650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.939264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 789/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:15.942903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.951565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e9af-448e-4139-89e9-7d44c545aaef admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.956828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.957532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.958326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.958326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.958797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.960508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.971702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 790/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:15.972610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.982285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d4d4a-c30f-430b-8dbf-1177bfffe10b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.987376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.988134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.988416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.988743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.989347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.990979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.998280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 808/1598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:15.999183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.007762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 791/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.008596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.014373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee194cf1-3a04-40af-bf70-d9ff1c44d6d8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.018777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be57f-9cd7-42a0-a883-aab3a246e34e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.019178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.019794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.020072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.020345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.021018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.022595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.023485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.024090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.024369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.024645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.025276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.027286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.033557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 809/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.034285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.044046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c67a8-840f-4ac6-86ec-1bda9ff9b2cb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.049193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.049936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.050218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.050493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.051738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.052754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.062937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 810/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.063735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.073403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c8358-3313-496d-b180-35c082ae6f9e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.078027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.078643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.078952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.079224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.079982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.081462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.091954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 811/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.092736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.102999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578d084-f532-49fb-9e0f-9f72cc7981b4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.107739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.108328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.108603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.108873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.109511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.114227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 792/1603] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:16.114414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.114541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.125765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 812/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.125976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce271-8043-4990-8c0f-d51753661383 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.126087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.128241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.128881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.129162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.129435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.130095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.131711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.133678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88662cb1-0ffc-4699-b52c-7137bd3068a2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.138604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.142181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.142181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.142181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.142181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.142181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.146358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 793/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.147551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.154865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 813/1606] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.154865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.165923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29d27d-037d-4c28-82c6-cdd3488e9503 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.170927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.171524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.172025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.172173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.172694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.175314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.186119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.186426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 814/1607] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.187263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.197431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd8b84-9d8a-472b-a0b3-05d7729d566e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.202057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.202648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.202953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.205838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.205838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.205838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.212937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfba8a-a99e-4979-a6da-18b1271c4911 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.215623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 815/1608] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.216425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.216693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.217312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.217588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.217855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.228163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14308a5-744f-495e-9366-a089c8a56019 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.228682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.230114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.233000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.233649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.237678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.237678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] PATH_INFO: `/v3/projects/048fc05529024faa9aa4605e8f404271/users/fbc1fd78028a4b1c91b7ff29ecd4b6f5/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.240634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 794/1609] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:16.241406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.250869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048fc05529024faa9aa4605e8f404271, user_id=fbc1fd78028a4b1c91b7ff29ecd4b6f5, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.251510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfd9e-9395-4258-8661-ed5d9f352255 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.254213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.257171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.257864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.258219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.258561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.259319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.261154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.271615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 795/1610] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:16.272413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.282011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e63f-258d-4149-ba2b-ca34d5ab3812 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.287113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.287755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.288033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.288325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] PATH_INFO: `/v3/projects/ca4408375d10434db0a11c0061357834/users/53a8b24fc774472da9687505b0ec0c9f/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.303696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4408375d10434db0a11c0061357834, user_id=53a8b24fc774472da9687505b0ec0c9f, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.306385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.333994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 816/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/048fc05529024faa9aa4605e8f404271/users/fbc1fd78028a4b1c91b7ff29ecd4b6f5/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:16.335113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.371105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.406284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29a6a-fd35-4e1f-890d-6389ff911fb8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.407737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 796/1612] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/ca4408375d10434db0a11c0061357834/users/53a8b24fc774472da9687505b0ec0c9f/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:16.408958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.479808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.480544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.480891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.481241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] PATH_INFO: `/v3/projects/2b528f2758e246d19953e525d24a29cc/users/e9b3debecd8c402a86fb2ad133bdd7d4/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.488774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f42d1-f2fd-430d-985e-827e9a778eaa admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.494188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.494830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.495117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.495395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] PATH_INFO: `/v3/projects/294826048813418e94b64571618f5e38/users/e1942539e3374378b0b3d7942f6304b3/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.498019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b528f2758e246d19953e525d24a29cc, user_id=e9b3debecd8c402a86fb2ad133bdd7d4, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.500742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.511428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] RBAC: Authorizing `identity:create_grant(project_id=294826048813418e94b64571618f5e38, user_id=e1942539e3374378b0b3d7942f6304b3, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.514101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.590830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 817/1613] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/2b528f2758e246d19953e525d24a29cc/users/e9b3debecd8c402a86fb2ad133bdd7d4/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:16.591633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.603203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 797/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/294826048813418e94b64571618f5e38/users/e1942539e3374378b0b3d7942f6304b3/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:16.604116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.666316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c3c2-6e80-4b6b-9a4d-4c434c64f32e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.671200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.671869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.672155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.672431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] PATH_INFO: `/v3/projects/7797c51149994709a3e02970149f5ba3/users/3d25ee8614f544dea0a2fb5b973e83a6/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.675595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307bc2-9bb3-4f6e-bc6d-3e0e2da8466e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.680369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339f907-4fde-42ef-a23b-2a85c9a10b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.681042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f907-4fde-42ef-a23b-2a85c9a10b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.681323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f907-4fde-42ef-a23b-2a85c9a10b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.681600 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f907-4fde-42ef-a23b-2a85c9a10b00 admin admin] PATH_INFO: `/v3/projects/b48f9187136149ce827d35aa388ecd0f/users/732e94e842254d69b2d08484c79a1efb/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.687887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7797c51149994709a3e02970149f5ba3, user_id=3d25ee8614f544dea0a2fb5b973e83a6, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.691087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.697473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339f907-4fde-42ef-a23b-2a85c9a10b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48f9187136149ce827d35aa388ecd0f, user_id=732e94e842254d69b2d08484c79a1efb, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.700139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339f907-4fde-42ef-a23b-2a85c9a10b00 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.786095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 818/1615] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/7797c51149994709a3e02970149f5ba3/users/3d25ee8614f544dea0a2fb5b973e83a6/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:16.787206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.808243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 798/1616] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/b48f9187136149ce827d35aa388ecd0f/users/732e94e842254d69b2d08484c79a1efb/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:16.810603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3289e-bc10-4022-9208-e4bef3d7be70 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.810603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3289e-bc10-4022-9208-e4bef3d7be70 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.810603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3289e-bc10-4022-9208-e4bef3d7be70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.819863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.832372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cdb3289e-bc10-4022-9208-e4bef3d7be70 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.833610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cdb3289e-bc10-4022-9208-e4bef3d7be70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.839639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.858559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297273-3559-411b-9257-1f7cee68328c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.896229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 799/1617] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:16.898172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f24d0-2211-4913-bca7-631e824d924e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.898577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f24d0-2211-4913-bca7-631e824d924e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.898982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f24d0-2211-4913-bca7-631e824d924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.918518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-596f24d0-2211-4913-bca7-631e824d924e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.919818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-596f24d0-2211-4913-bca7-631e824d924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.920484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7b50-5050-4641-8fc0-dc272f46d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.921183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7b50-5050-4641-8fc0-dc272f46d2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.921464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7b50-5050-4641-8fc0-dc272f46d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.921740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7b50-5050-4641-8fc0-dc272f46d2ec admin admin] PATH_INFO: `/v3/projects/66bce46ad802486284775947de70ae27/users/476942e8ed844284893ef706df80116c/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.930428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 800/1618] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:16.930428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f24d0-2211-4913-bca7-631e824d924e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.937228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b7b50-5050-4641-8fc0-dc272f46d2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bce46ad802486284775947de70ae27, user_id=476942e8ed844284893ef706df80116c, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.941008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b7b50-5050-4641-8fc0-dc272f46d2ec admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.985982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f24d0-2211-4913-bca7-631e824d924e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.989802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565fa64-ef15-4725-b5ff-2d6b93728903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.990410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565fa64-ef15-4725-b5ff-2d6b93728903 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.990710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565fa64-ef15-4725-b5ff-2d6b93728903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.990995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565fa64-ef15-4725-b5ff-2d6b93728903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.005795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 819/1619] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:16 2022] PUT /identity/v3/projects/66bce46ad802486284775947de70ae27/users/476942e8ed844284893ef706df80116c/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:17.005795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a814-cedb-4c87-a6f9-bca1b4d48fad None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.005795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a814-cedb-4c87-a6f9-bca1b4d48fad None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.005795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a814-cedb-4c87-a6f9-bca1b4d48fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.023794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-75a7a814-cedb-4c87-a6f9-bca1b4d48fad None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.025007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75a7a814-cedb-4c87-a6f9-bca1b4d48fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.049638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565fa64-ef15-4725-b5ff-2d6b93728903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.051128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565fa64-ef15-4725-b5ff-2d6b93728903 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.060318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 801/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.061701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d45d8-0b43-4a79-a879-b9a4f9c55f1a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.062006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d45d8-0b43-4a79-a879-b9a4f9c55f1a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.062275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d45d8-0b43-4a79-a879-b9a4f9c55f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.083653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-216d45d8-0b43-4a79-a879-b9a4f9c55f1a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.084884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-216d45d8-0b43-4a79-a879-b9a4f9c55f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.094969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 820/1621] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:17.096354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.096659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.096910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.128270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] MFA Rules not processed for user `3d25ee8614f544dea0a2fb5b973e83a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.129561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.145654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.159628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 802/1622] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:17.161014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.161301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.161574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.180168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.181368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.191016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 803/1623] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:17.191968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.206377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.210313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 821/1624] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:17.211321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.213927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.258389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0fe89-dd61-4d3c-a3e1-71d3a0db80ec None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.262371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.263002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.263286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.263558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.273561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.275030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.275237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8766-12ea-4b4a-be55-87eeb44db4c1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.278891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.279489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.279766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.280041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.285526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 804/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.286398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.290609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.296064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.296187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e437b6-77f9-4ef6-89d0-9e82b8682cb7 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.301615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.302180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.302463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.302857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.303521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 822/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.303660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.305303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.307904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.327123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277985-cc13-4637-a3f8-50d278888641 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.332112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.333070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.333692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 805/1627] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:17.334141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.334522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.334676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.344182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e1911-4c27-41db-b3aa-251696c856f2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.344588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.346838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.348688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.349306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.349602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.349882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.358873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 823/1628] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.359125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.359924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.360633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.368527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136a17f-7d7b-4029-8466-49d68ec3fea2 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.370752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 806/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.372919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.373607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.373954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.374304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.375886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.386408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.388029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.390371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d9dc-7805-45d3-b24c-268af0854b81 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.396332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.396976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.397242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.397518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.398182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.400393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.402304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 824/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.403383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.415791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83595-0903-4361-9d1b-2f9c4fa7219f service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.422472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af21a1d-2448-4ac4-87a2-4476cd33a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.423440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21a1d-2448-4ac4-87a2-4476cd33a2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.423736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21a1d-2448-4ac4-87a2-4476cd33a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.424213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21a1d-2448-4ac4-87a2-4476cd33a2ba admin admin] PATH_INFO: `/v3/projects/66bce46ad802486284775947de70ae27/users/476942e8ed844284893ef706df80116c/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.426495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af21a1d-2448-4ac4-87a2-4476cd33a2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bce46ad802486284775947de70ae27, user_id=476942e8ed844284893ef706df80116c, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.430146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af21a1d-2448-4ac4-87a2-4476cd33a2ba admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.450294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 825/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:17 2022] PUT /identity/v3/projects/66bce46ad802486284775947de70ae27/users/476942e8ed844284893ef706df80116c/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:17.461791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.462529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.463111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.508210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] MFA Rules not processed for user `476942e8ed844284893ef706df80116c`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.508210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.587249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 826/1632] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:17.599337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.621229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 807/1633] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:17.623644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.686975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.692689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702847e-ddfc-492c-87fd-b72dc3502381 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.709523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39fcca-4131-415d-b28f-8aa85776098c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.714549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.715262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.715555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.715834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.716477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.719094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.769348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.769987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.770266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.770539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.839416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 808/1634] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:17.858022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.893712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea838f0-0370-457c-be1a-ddaeb6a0dbc0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.893916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.895356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.910340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.911224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.911968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.912102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 827/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:17.915082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.916055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.919845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.945954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.952913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 809/1636] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:17.964009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe26640-4683-46f1-b65a-2854fb9776ac service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.977851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.977851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.977851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.977851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] PATH_INFO: `/v3/projects/48b8b01de9684047a166283269ad2189/users/4e58771e8e5d49fc8420c60804b8f7ff/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.037614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b8b01de9684047a166283269ad2189, user_id=4e58771e8e5d49fc8420c60804b8f7ff, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.050638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.141104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 828/1637] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:17 2022] PUT /identity/v3/projects/48b8b01de9684047a166283269ad2189/users/4e58771e8e5d49fc8420c60804b8f7ff/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:18.143544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.155973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784368a0-44f9-4905-9c9d-a922f159e20f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.197394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.228997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.285446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.285973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.286194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.286476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.287279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.305434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.338823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 810/1638] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:18.350281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.377331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33343a3-583b-4870-aaa8-f5611dbec36c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.391898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9350-9eb7-4f8e-ae0c-ba7ca2ff02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.392791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9350-9eb7-4f8e-ae0c-ba7ca2ff02d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.394020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9350-9eb7-4f8e-ae0c-ba7ca2ff02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.395399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9350-9eb7-4f8e-ae0c-ba7ca2ff02d2 admin admin] PATH_INFO: `/v3/projects/48b8b01de9684047a166283269ad2189/users/4e58771e8e5d49fc8420c60804b8f7ff/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.399782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad9350-9eb7-4f8e-ae0c-ba7ca2ff02d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b8b01de9684047a166283269ad2189, user_id=4e58771e8e5d49fc8420c60804b8f7ff, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.406865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a7714-bb19-4149-a197-d5432aa4f1a0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.407015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad9350-9eb7-4f8e-ae0c-ba7ca2ff02d2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.417999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.420333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.420562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.420848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] PATH_INFO: `/v3/users/d688cd69ca334bb7a47d7cd21ff51110` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.426137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d688cd69ca334bb7a47d7cd21ff51110)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.441116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 811/1639] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:18 2022] PUT /identity/v3/projects/48b8b01de9684047a166283269ad2189/users/4e58771e8e5d49fc8420c60804b8f7ff/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:18.441468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.447071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.447588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.447876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.500094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] MFA Rules not processed for user `4e58771e8e5d49fc8420c60804b8f7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:18.501348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:18.575834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 812/1640] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:18.586999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.648793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cec6c-0d32-4d78-ba0c-b8150085f991 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.652959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330793ef-607f-4b0b-bc55-7c100cfce83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.653385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330793ef-607f-4b0b-bc55-7c100cfce83d service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.653856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330793ef-607f-4b0b-bc55-7c100cfce83d service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.654190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330793ef-607f-4b0b-bc55-7c100cfce83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.697942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.717493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.727312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd688cd69ca334bb7a47d7cd21ff51110'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:18.728841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd688cd69ca334bb7a47d7cd21ff51110'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:18.741817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330793ef-607f-4b0b-bc55-7c100cfce83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.744452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330793ef-607f-4b0b-bc55-7c100cfce83d service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.749436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd688cd69ca334bb7a47d7cd21ff51110'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:18.783788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 813/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:18.837791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd688cd69ca334bb7a47d7cd21ff51110'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:18.839571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd688cd69ca334bb7a47d7cd21ff51110'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:18.873053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 829/1642] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:18 2022] DELETE /identity/v3/users/d688cd69ca334bb7a47d7cd21ff51110 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:18.873977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1c80-6a51-480f-b901-bf0065fb3425 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.874501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1c80-6a51-480f-b901-bf0065fb3425 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.874595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1c80-6a51-480f-b901-bf0065fb3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.914740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ddff1c80-6a51-480f-b901-bf0065fb3425 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:18.916062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ddff1c80-6a51-480f-b901-bf0065fb3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:19.317173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 814/1643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:19.322454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:19.322454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:19.322454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522f1d-8a4a-4a24-82c3-32d5b7f18758 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:19.324363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:19.324363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.324363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.324363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.325377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:19.325377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:19.325377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 830/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:19.968860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.969389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.969389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.988821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:19.991569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.019489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c011d53-750c-4243-915c-74bfd23a3d05 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.035375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.036029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.036308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.036579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] PATH_INFO: `/v3/projects/bdd5e9c92dd440429d3faf3eac3684ac` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.038793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd5e9c92dd440429d3faf3eac3684ac)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.039846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:20.039846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Aug 24 05:39:20.039846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: Aug 24 05:39:20.042604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.049957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] MFA Rules not processed for user `732e94e842254d69b2d08484c79a1efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:20.049957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.246475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 815/1645] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:20.250191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.252857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.280593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f1728-56f7-4a60-85dc-fc78583ef095 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.282364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd5e9c92dd440429d3faf3eac3684ac', 'request_id': 'req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.379633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.380375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.381154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.381514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.382656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.384898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.390307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd5e9c92dd440429d3faf3eac3684ac', 'request_id': 'req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.414027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd5e9c92dd440429d3faf3eac3684ac', 'request_id': 'req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.436377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] The token cache is being invalidate because project bdd5e9c92dd440429d3faf3eac3684ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:20.436996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.437859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.443230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 831/1646] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:19 2022] DELETE /identity/v3/projects/bdd5e9c92dd440429d3faf3eac3684ac => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:20.445393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.447250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.467217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c236-7ec0-43d4-ba25-affa3cc058e4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.477876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.478986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.479165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.479635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] PATH_INFO: `/v3/users/476942e8ed844284893ef706df80116c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.482173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=476942e8ed844284893ef706df80116c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.484305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.540691 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.547786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 816/1647] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:20 2022] POST /identity/v3/projects => generated 403 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:39:20.552332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.554192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.694013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.726625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476942e8ed844284893ef706df80116c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.728973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476942e8ed844284893ef706df80116c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.734889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62390e8-1092-467b-b9af-c0cdbce916a9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.752869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.753711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.754391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.754674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.755349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.767339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.787218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476942e8ed844284893ef706df80116c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.900476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476942e8ed844284893ef706df80116c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.903163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476942e8ed844284893ef706df80116c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:20.926960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 817/1648] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:20 2022] POST /identity/v3/users => generated 308 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:39:20.931441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.935784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.964854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 832/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:20 2022] DELETE /identity/v3/users/476942e8ed844284893ef706df80116c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:20.991748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cacff0-379d-443b-87f2-b7e0a7513963 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.117324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.117888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.118315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.118602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.119492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.121119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.137239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 818/1650] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:21.139625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.175872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a913e-3e75-448c-9305-c06940a2cedf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.183431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.184724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.185419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.186462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] PATH_INFO: `/v3/projects/e932e316479f4433ab2bffddeaea62a3/users/8e87a3c65ab74b3387420444db5b84bf/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.211118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e932e316479f4433ab2bffddeaea62a3, user_id=8e87a3c65ab74b3387420444db5b84bf, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.214718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.277625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.278083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 833/1651] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:21 2022] PUT /identity/v3/projects/e932e316479f4433ab2bffddeaea62a3/users/8e87a3c65ab74b3387420444db5b84bf/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:21.288963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2c02-99f7-4033-82f5-1eebcb1d5826 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.360354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.361295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.361616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.362589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.362843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.364559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.389609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.398385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 819/1652] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:21.402789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ddef-08df-46a5-bde8-7a53f389a327 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.409769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.410481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.410904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.411199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] PATH_INFO: `/v3/projects/e932e316479f4433ab2bffddeaea62a3/users/8e87a3c65ab74b3387420444db5b84bf/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.415037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e932e316479f4433ab2bffddeaea62a3, user_id=8e87a3c65ab74b3387420444db5b84bf, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.416708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.451329 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 834/1653] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:21 2022] PUT /identity/v3/projects/e932e316479f4433ab2bffddeaea62a3/users/8e87a3c65ab74b3387420444db5b84bf/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:23.246495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:23.252310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:23.280808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489b694-d39c-4305-b68a-77529263b000 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.334101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:23.461517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.462557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.467838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.468495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] PATH_INFO: `/v3/projects/66bce46ad802486284775947de70ae27` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.470258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66bce46ad802486284775947de70ae27)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.474563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.486990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:23.493070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:23.636929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da19bf8-da27-4a9e-a6e7-4f51ec84b29d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.645927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.647095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.647818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.648187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.651806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:23.677986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66bce46ad802486284775947de70ae27', 'request_id': 'req-11c8a857-685e-4a38-b0f2-5bb378c80e03'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:23.753453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.755288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f42605-7286-4804-a980-0435d4a87ec8 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.770225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 835/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:23.790203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66bce46ad802486284775947de70ae27', 'request_id': 'req-11c8a857-685e-4a38-b0f2-5bb378c80e03'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:23.801726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66bce46ad802486284775947de70ae27', 'request_id': 'req-11c8a857-685e-4a38-b0f2-5bb378c80e03'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:23.840837 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] The token cache is being invalidate because project 66bce46ad802486284775947de70ae27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:23.841609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:23.843864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11c8a857-685e-4a38-b0f2-5bb378c80e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:23.849775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 820/1655] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:23 2022] DELETE /identity/v3/projects/66bce46ad802486284775947de70ae27 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:23.854925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.855414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.861114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.899769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:23.902654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:23.948469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.133446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 836/1656] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:24.141275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.141633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.143623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.196692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:24.201178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:24.239536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 821/1657] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:24.243903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.261598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261794-fadd-4c90-999d-eacb100091ed None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.283834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.289266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.291580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.291857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.296275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:24.301240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.303020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:24.370020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 837/1658] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:24.374615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.392700 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e4af-77dc-4bcf-8e8d-03a426bbd99f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.415264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.416079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.416647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.418808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.426403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.441085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:24.614961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 822/1659] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:24 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:24.619641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.636522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16052cc2-e2f7-4062-a435-d0de94cbf1c8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.854834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.861755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.862673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.863703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.865200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.904482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.108068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 838/1660] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:24 2022] POST /identity/v3/users => generated 287 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:25.109488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.125717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460fe2-809e-481c-a3dd-6d7ec0827d72 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.156764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.158868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.159338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.160496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.177171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.189281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.229832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 823/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:25.230592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.255652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8155c6-7228-42cc-8904-55c493f35a81 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.280178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962ad6-2af2-43ff-a7a4-858ee7f95b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.283190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962ad6-2af2-43ff-a7a4-858ee7f95b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.283525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962ad6-2af2-43ff-a7a4-858ee7f95b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.283781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962ad6-2af2-43ff-a7a4-858ee7f95b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.284492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d962ad6-2af2-43ff-a7a4-858ee7f95b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.287692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d962ad6-2af2-43ff-a7a4-858ee7f95b1b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.320775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.323331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 839/1662] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:39:25.355357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0167d1-2d2e-4d0e-b731-738a7225b56a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.364614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.365572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.373225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.373225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] PATH_INFO: `/v3/projects/7e2138b46a3c4af29636a0daab81574d/users/d8f3cabdbaf74060a6a4459c4c6ab48a/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.406086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2138b46a3c4af29636a0daab81574d, user_id=d8f3cabdbaf74060a6a4459c4c6ab48a, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.409684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.529849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 824/1663] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:25 2022] PUT /identity/v3/projects/7e2138b46a3c4af29636a0daab81574d/users/d8f3cabdbaf74060a6a4459c4c6ab48a/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:25.543745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.544038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.544315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.621792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] MFA Rules not processed for user `d8f3cabdbaf74060a6a4459c4c6ab48a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:25.621792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:25.774868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 840/1664] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:25.776036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.900958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:25.935976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cde70-2cfe-48b0-adca-67d3f32fc306 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.955596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.956481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.956947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.957345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.958125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.960264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.109817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 825/1665] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:25 2022] POST /identity/v3/projects => generated 371 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:26.114338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.127656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774c4ad-0f87-4757-a32f-23e50b41d7a6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.165330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.289862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.290502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.290859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.291136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.291808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.293789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.374468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 841/1666] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:26 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:39:26.379750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.399092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5aa42-0df5-4abc-a014-2f40e06a0b46 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.422535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.424042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.424378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.424659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.425342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.429668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.453651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 826/1667] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:26.457355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.472365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5d45-ccbc-4c60-b5d4-cf93b76d5f35 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.486638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8783d-9d07-4186-be8b-47be3e3209a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.487524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8783d-9d07-4186-be8b-47be3e3209a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.487808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8783d-9d07-4186-be8b-47be3e3209a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.488086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8783d-9d07-4186-be8b-47be3e3209a1 admin admin] PATH_INFO: `/v3/projects/6f6553e14c3542b685d5151a98df9a7a/users/1dd16ca73b874b718c7f75877f6477e7/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.508988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8783d-9d07-4186-be8b-47be3e3209a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6553e14c3542b685d5151a98df9a7a, user_id=1dd16ca73b874b718c7f75877f6477e7, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.512162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8783d-9d07-4186-be8b-47be3e3209a1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.658496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 842/1668] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:26 2022] PUT /identity/v3/projects/6f6553e14c3542b685d5151a98df9a7a/users/1dd16ca73b874b718c7f75877f6477e7/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:26.659657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.665815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.667359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.667851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.671321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38d730-7172-4fef-9f78-37fa96f43d9e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.724944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] MFA Rules not processed for user `8e87a3c65ab74b3387420444db5b84bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:26.727900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:26.775679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.775679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.775679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.775679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.778000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.781999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.818040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 827/1669] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:26.821402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.858187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10894-52c2-40f6-aa34-c3974903c080 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.867408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a205d9-3b84-40af-be23-e467504f5944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.868310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a205d9-3b84-40af-be23-e467504f5944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.868592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a205d9-3b84-40af-be23-e467504f5944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.868878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a205d9-3b84-40af-be23-e467504f5944 admin admin] PATH_INFO: `/v3/projects/6f6553e14c3542b685d5151a98df9a7a/users/1dd16ca73b874b718c7f75877f6477e7/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.871376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a205d9-3b84-40af-be23-e467504f5944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6553e14c3542b685d5151a98df9a7a, user_id=1dd16ca73b874b718c7f75877f6477e7, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.875604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a205d9-3b84-40af-be23-e467504f5944 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.897912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 828/1670] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:26 2022] PUT /identity/v3/projects/6f6553e14c3542b685d5151a98df9a7a/users/1dd16ca73b874b718c7f75877f6477e7/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:26.909069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.909357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.909642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.963969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 843/1671] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:27.014738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] MFA Rules not processed for user `1dd16ca73b874b718c7f75877f6477e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:27.014738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:27.196354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 829/1672] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:27.231864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:27.233746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:27.318279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78562-499d-4ec1-9f81-085839afa6a7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:27.344953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:27.415817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce56c1-d581-42ba-abbb-c2fa588a5e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:27.416551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce56c1-d581-42ba-abbb-c2fa588a5e50 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.417887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce56c1-d581-42ba-abbb-c2fa588a5e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.418790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce56c1-d581-42ba-abbb-c2fa588a5e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.442747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce56c1-d581-42ba-abbb-c2fa588a5e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:27.446481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce56c1-d581-42ba-abbb-c2fa588a5e50 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:27.469426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 844/1673] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:27.919490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:27.956142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78984-e12c-4d3a-aa85-b721cad0532b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:27.969823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247586-5661-4f27-a6d0-f99f4ba04d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:27.971036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247586-5661-4f27-a6d0-f99f4ba04d26 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.978838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247586-5661-4f27-a6d0-f99f4ba04d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.979125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247586-5661-4f27-a6d0-f99f4ba04d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.101391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.170585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247586-5661-4f27-a6d0-f99f4ba04d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.172670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247586-5661-4f27-a6d0-f99f4ba04d26 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.202231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 830/1674] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:28.910579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e10fa-1059-4572-bca8-648d40b4e332 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.911167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e10fa-1059-4572-bca8-648d40b4e332 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.911167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e10fa-1059-4572-bca8-648d40b4e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.948693 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1a1e10fa-1059-4572-bca8-648d40b4e332 None None] MFA Rules not processed for user `e1942539e3374378b0b3d7942f6304b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:28.949941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1a1e10fa-1059-4572-bca8-648d40b4e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:29.050493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 845/1675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:29.102143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1169ae-bc41-4be3-a2ad-26d0599c3e37 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.102727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1169ae-bc41-4be3-a2ad-26d0599c3e37 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.102975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1169ae-bc41-4be3-a2ad-26d0599c3e37 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.104501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 831/1676] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 05:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:29.121160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.121452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.121731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.173221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48b8b-42f5-4f19-ab8f-642550d5bfec None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.173511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48b8b-42f5-4f19-ab8f-642550d5bfec None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.173792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48b8b-42f5-4f19-ab8f-642550d5bfec None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.175558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 832/1677] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:29.183026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:29.184449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:29.202549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a702-1d6a-4b66-833f-236e9e133de2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.203041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a702-1d6a-4b66-833f-236e9e133de2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.203462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a702-1d6a-4b66-833f-236e9e133de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.269560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d956a702-1d6a-4b66-833f-236e9e133de2 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:29.272506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d956a702-1d6a-4b66-833f-236e9e133de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:29.326180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 846/1678] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 05:39:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:29.327695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:29.342498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c884-4a9d-45f3-b4e8-2b228f38e105 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.351212 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104766-70ef-4c21-8380-ea21342302fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.352208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104766-70ef-4c21-8380-ea21342302fe service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.352493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104766-70ef-4c21-8380-ea21342302fe service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.353233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104766-70ef-4c21-8380-ea21342302fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.373910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104766-70ef-4c21-8380-ea21342302fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.383212 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104766-70ef-4c21-8380-ea21342302fe service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.388399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 833/1679] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:39:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:29.399327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 847/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:29.430132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4656667-e96f-4062-b771-be2ff2b7ab0d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.431660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4656667-e96f-4062-b771-be2ff2b7ab0d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.432964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4656667-e96f-4062-b771-be2ff2b7ab0d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.439453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 834/1681] 10.222.0.27 () {54 vars in 961 bytes} [Wed Aug 24 05:39:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:29.450705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460788-d3ac-40d1-9200-af0624deec38 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.451124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460788-d3ac-40d1-9200-af0624deec38 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.451494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460788-d3ac-40d1-9200-af0624deec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.519070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ab460788-d3ac-40d1-9200-af0624deec38 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:29.522505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ab460788-d3ac-40d1-9200-af0624deec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:29.546875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 848/1682] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Aug 24 05:39:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:29.558535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4656667-e96f-4062-b771-be2ff2b7ab0d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:29.583457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4656667-e96f-4062-b771-be2ff2b7ab0d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.609321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d652ce-98c0-4401-8cf2-ba876b837b90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.621647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d652ce-98c0-4401-8cf2-ba876b837b90 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.623029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d652ce-98c0-4401-8cf2-ba876b837b90 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.623487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d652ce-98c0-4401-8cf2-ba876b837b90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.647382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d652ce-98c0-4401-8cf2-ba876b837b90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.649383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d652ce-98c0-4401-8cf2-ba876b837b90 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.676503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 835/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:31.221642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ef294-c747-4bdc-9ba3-6c13a7827e0c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.222273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ef294-c747-4bdc-9ba3-6c13a7827e0c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.222388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ef294-c747-4bdc-9ba3-6c13a7827e0c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.224835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 849/1684] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:39:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:31.240104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.240634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.240634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.276286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] MFA Rules not processed for user `62840e2e8fc94605a933c66f34dee30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:31.277720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:31.303377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 836/1685] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:39:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:31.325941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ef294-c747-4bdc-9ba3-6c13a7827e0c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.345783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ef294-c747-4bdc-9ba3-6c13a7827e0c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.357745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.357745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.357745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.357745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.364457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:31.366222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:31.373496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.391986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 850/1686] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:31.444066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.445866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:31.613615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8a05e-6778-474b-aa1f-8c6f17aee9f4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.619842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.621153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.622277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.622667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] PATH_INFO: `/v3/users/732e94e842254d69b2d08484c79a1efb` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.627110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732e94e842254d69b2d08484c79a1efb)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:31.629154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:31.629154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 24 05:39:31.629154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: Aug 24 05:39:31.632316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:31.939703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732e94e842254d69b2d08484c79a1efb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:31.941730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:32.004084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732e94e842254d69b2d08484c79a1efb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:32.005379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732e94e842254d69b2d08484c79a1efb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:32.070404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732e94e842254d69b2d08484c79a1efb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:32.087336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732e94e842254d69b2d08484c79a1efb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:32.119634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 837/1687] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:31 2022] DELETE /identity/v3/users/732e94e842254d69b2d08484c79a1efb => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:32.831942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:32.846670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c3d29-a2dc-4e89-94b8-5ee0bfddf08f service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:33.107779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:33.109543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:33.109829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:33.110216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] PATH_INFO: `/v3/projects/b48f9187136149ce827d35aa388ecd0f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:33.117948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48f9187136149ce827d35aa388ecd0f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:33.128182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:33.448153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48f9187136149ce827d35aa388ecd0f', 'request_id': 'req-68176765-7ce9-43c0-af2d-56d63f096bc6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:33.590328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48f9187136149ce827d35aa388ecd0f', 'request_id': 'req-68176765-7ce9-43c0-af2d-56d63f096bc6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:33.599710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48f9187136149ce827d35aa388ecd0f', 'request_id': 'req-68176765-7ce9-43c0-af2d-56d63f096bc6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:33.629377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] The token cache is being invalidate because project b48f9187136149ce827d35aa388ecd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:33.630169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:33.630580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68176765-7ce9-43c0-af2d-56d63f096bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:33.632499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 851/1688] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:32 2022] DELETE /identity/v3/projects/b48f9187136149ce827d35aa388ecd0f => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:33.636804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:33.638910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:33.663886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6fd7f-788e-449f-ad2e-ec59e19c8273 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:33.823642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:33.824740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:33.825426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:33.825895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] PATH_INFO: `/v3/users/8e87a3c65ab74b3387420444db5b84bf` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:33.827405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e87a3c65ab74b3387420444db5b84bf)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:33.830429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:34.061872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e87a3c65ab74b3387420444db5b84bf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:34.093992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e87a3c65ab74b3387420444db5b84bf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:34.095311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e87a3c65ab74b3387420444db5b84bf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:34.209469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e87a3c65ab74b3387420444db5b84bf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:34.216572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e87a3c65ab74b3387420444db5b84bf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:34.227402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 838/1689] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:33 2022] DELETE /identity/v3/users/8e87a3c65ab74b3387420444db5b84bf => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:35.906433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abda14-a21b-47ec-8fb1-0870a916ea91 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.907972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abda14-a21b-47ec-8fb1-0870a916ea91 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.908282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abda14-a21b-47ec-8fb1-0870a916ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.023589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-64abda14-a21b-47ec-8fb1-0870a916ea91 None None] MFA Rules not processed for user `e1942539e3374378b0b3d7942f6304b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:36.024864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-64abda14-a21b-47ec-8fb1-0870a916ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:36.236462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 852/1690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:36.269973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.271479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:36.456438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.516977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb72d-3e59-4638-8065-81c582e9e02c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.529553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.534424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.535105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.537614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] PATH_INFO: `/v3/projects/e932e316479f4433ab2bffddeaea62a3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.548867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e932e316479f4433ab2bffddeaea62a3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:36.552351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.763240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.763710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.768163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.774189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e932e316479f4433ab2bffddeaea62a3', 'request_id': 'req-a514b027-61c9-431e-9898-ff4a1ba48428'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:36.857901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] MFA Rules not processed for user `fbc1fd78028a4b1c91b7ff29ecd4b6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:36.859528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:36.898046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e932e316479f4433ab2bffddeaea62a3', 'request_id': 'req-a514b027-61c9-431e-9898-ff4a1ba48428'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:36.908442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e932e316479f4433ab2bffddeaea62a3', 'request_id': 'req-a514b027-61c9-431e-9898-ff4a1ba48428'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:36.925806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.942748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] The token cache is being invalidate because project e932e316479f4433ab2bffddeaea62a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:36.942748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:36.947579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a514b027-61c9-431e-9898-ff4a1ba48428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:36.952463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 839/1691] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:36 2022] DELETE /identity/v3/projects/e932e316479f4433ab2bffddeaea62a3 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:36.957860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841e80-0d31-4c59-87c2-41376e920445 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.958090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841e80-0d31-4c59-87c2-41376e920445 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.958330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841e80-0d31-4c59-87c2-41376e920445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.022207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f5841e80-0d31-4c59-87c2-41376e920445 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:37.023465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f5841e80-0d31-4c59-87c2-41376e920445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:37.026217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 853/1692] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:37.042139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.044216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:37.211921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 840/1693] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:37.216059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb756-a18c-4c46-85f9-69a5ad5e8607 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.217501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb756-a18c-4c46-85f9-69a5ad5e8607 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.217688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb756-a18c-4c46-85f9-69a5ad5e8607 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.221524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 841/1694] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 05:39:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:37.221524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.221524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.221524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.227722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085fafd-4251-4566-a6b1-0615304a0f94 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.238157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d088d4-e8f9-442a-9e29-0527d5825161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.238935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d088d4-e8f9-442a-9e29-0527d5825161 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.239217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d088d4-e8f9-442a-9e29-0527d5825161 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.239540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d088d4-e8f9-442a-9e29-0527d5825161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.259570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d088d4-e8f9-442a-9e29-0527d5825161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.261769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d088d4-e8f9-442a-9e29-0527d5825161 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.278452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:37.279784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:37.290199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 854/1695] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:37.291537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61599fa1-10ab-45a7-a081-51c4e6818509 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.291823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61599fa1-10ab-45a7-a081-51c4e6818509 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.292092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61599fa1-10ab-45a7-a081-51c4e6818509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.298519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 842/1696] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:37.305202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.324941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2d3af-e306-4e88-a382-11499bb1df37 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.336084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-61599fa1-10ab-45a7-a081-51c4e6818509 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:37.343419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61599fa1-10ab-45a7-a081-51c4e6818509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:37.353230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.354009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.354363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.354733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.360615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:37.367839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.375838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.376019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 855/1697] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 05:39:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:37.382160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0522f-1eae-4a7d-bc17-5d7714735401 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.382827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0522f-1eae-4a7d-bc17-5d7714735401 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.383245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0522f-1eae-4a7d-bc17-5d7714735401 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.384824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 856/1698] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 05:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:37.391045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.391556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.392032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.417114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 843/1699] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:37.418135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.438578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:37.440445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:37.447350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d377a37-b86a-41e9-abcf-836e433d6ac4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.454636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 857/1700] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:39:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:37.460139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.460945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.461368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.461768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.467786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.467786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.476500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.478752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:37.601365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d195e-fcc8-41ea-80b2-aaa72ac18545 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.607857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.608553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.610554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.610554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.620319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 844/1701] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:37 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:37.622421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.629255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.632097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.654768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 858/1702] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:37.775914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.832985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc272d-5cbc-4633-9e28-0921b1c24849 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.854769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.878164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.879734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.879969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.881682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.889462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.064384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 845/1703] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:37 2022] POST /identity/v3/users => generated 290 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:38.065248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.086067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e2acf-ec1c-4ee8-aa34-80e26d480e7a service glance] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.105767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.106563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.109492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.110184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.111690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.116578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.151516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 859/1704] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:38.159527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.175250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5f7fc-0d99-4cf6-b87f-a186de327cbc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.200343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4c180-4cad-4906-810d-cbe3248c7b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.201348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4c180-4cad-4906-810d-cbe3248c7b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.201348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4c180-4cad-4906-810d-cbe3248c7b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.201629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4c180-4cad-4906-810d-cbe3248c7b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.202289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4c180-4cad-4906-810d-cbe3248c7b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.204556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4c180-4cad-4906-810d-cbe3248c7b29 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.247612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 846/1705] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:38.248645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.271861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d5e-44ee-4eaf-a917-bbc2ec604b37 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.296872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.302248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.302685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.302995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] PATH_INFO: `/v3/projects/c55a79c353da458d9ea61491db8bcd65/users/1505c9b912cc4935b54ab85b9fe14d08/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.319071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:38.348893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55a79c353da458d9ea61491db8bcd65, user_id=1505c9b912cc4935b54ab85b9fe14d08, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.354872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.460476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 860/1706] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:38 2022] PUT /identity/v3/projects/c55a79c353da458d9ea61491db8bcd65/users/1505c9b912cc4935b54ab85b9fe14d08/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:38.481610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbbca6-19e1-4dee-a7a1-1f6db957dcb8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.482293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbbca6-19e1-4dee-a7a1-1f6db957dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.483010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbbca6-19e1-4dee-a7a1-1f6db957dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.581611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-dcdbbca6-19e1-4dee-a7a1-1f6db957dcb8 None None] MFA Rules not processed for user `1505c9b912cc4935b54ab85b9fe14d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:38.583698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dcdbbca6-19e1-4dee-a7a1-1f6db957dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:38.875153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 847/1707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:38.883063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.978589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c382-959b-48af-90a2-9eeb14874449 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.980076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c382-959b-48af-90a2-9eeb14874449 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.980560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c382-959b-48af-90a2-9eeb14874449 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.983905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 848/1708] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 05:39:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:38.990222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.990830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.991198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.060097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b10d4-b769-4e0c-86b7-0205ebb9613e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.066933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd981f-e969-4755-9dad-7b05a4e8017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.068783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd981f-e969-4755-9dad-7b05a4e8017d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.069123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd981f-e969-4755-9dad-7b05a4e8017d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.069451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd981f-e969-4755-9dad-7b05a4e8017d admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.071501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd981f-e969-4755-9dad-7b05a4e8017d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.074214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd981f-e969-4755-9dad-7b05a4e8017d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.099774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:39.103215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:39.176147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 861/1709] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:39.179317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4db42-fef7-4c7a-a581-2bcea3cf1101 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.179602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4db42-fef7-4c7a-a581-2bcea3cf1101 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.179873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4db42-fef7-4c7a-a581-2bcea3cf1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.217067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 849/1710] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:39.220032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.246452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b6b02-0c6c-4ffa-8708-7d80011d0a10 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.251113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3db4db42-fef7-4c7a-a581-2bcea3cf1101 None None] MFA Rules not processed for user `e9b3debecd8c402a86fb2ad133bdd7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:39.253159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3db4db42-fef7-4c7a-a581-2bcea3cf1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:39.322639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:39.408409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.409177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.409507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.410399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.411482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.414183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.460902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 862/1711] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:39.462432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f61d-20bf-4027-8780-26f7cd8818f8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.463204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f61d-20bf-4027-8780-26f7cd8818f8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.463204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f61d-20bf-4027-8780-26f7cd8818f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.514532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8d54f61d-20bf-4027-8780-26f7cd8818f8 None None] MFA Rules not processed for user `53a8b24fc774472da9687505b0ec0c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:39.519690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8d54f61d-20bf-4027-8780-26f7cd8818f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:39.546449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 850/1712] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:39 2022] POST /identity/v3/users => generated 296 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:39.548265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.550794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:39.632994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:39.661647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a59917-4993-43da-90b0-68558474d693 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.670626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.671284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 863/1713] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:39.671610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.671966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.672378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.674398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8e8c-b32f-4ba0-802c-8dd9033ac62f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.674728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8e8c-b32f-4ba0-802c-8dd9033ac62f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.675006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8e8c-b32f-4ba0-802c-8dd9033ac62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.696298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.698473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.703266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4c1a8e8c-b32f-4ba0-802c-8dd9033ac62f None None] MFA Rules not processed for user `e9b3debecd8c402a86fb2ad133bdd7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:39.707386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4c1a8e8c-b32f-4ba0-802c-8dd9033ac62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:39.717664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 851/1714] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:39.718894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.723489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 864/1715] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:39.726430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.727108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.727699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.746803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472384ed-7c54-4057-a3a2-03350935f21d service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.754021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.755130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.755770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.756235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.757066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.758963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.788729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] MFA Rules not processed for user `53a8b24fc774472da9687505b0ec0c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:39.798446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 852/1716] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:39.798446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.801719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:39.819829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 865/1717] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:39.825295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.847644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e646d-3854-4d5b-95d7-239567c792be None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.865191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.866338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.868088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.868415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] PATH_INFO: `/v3/projects/8cfd9ce81e7540e48df29312a7b52b04/users/a8e1c0f89fd247ccb2af8c524901934d/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.917697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfd9ce81e7540e48df29312a7b52b04, user_id=a8e1c0f89fd247ccb2af8c524901934d, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.921476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.021481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b472d6-0bb0-4c76-b191-e348b2a4143c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.036031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17095e1b-a56c-4de6-9a6f-3e22d4ebf46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.036831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17095e1b-a56c-4de6-9a6f-3e22d4ebf46d service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.037256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17095e1b-a56c-4de6-9a6f-3e22d4ebf46d service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.037666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17095e1b-a56c-4de6-9a6f-3e22d4ebf46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.055764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 866/1718] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:39 2022] PUT /identity/v3/projects/8cfd9ce81e7540e48df29312a7b52b04/users/a8e1c0f89fd247ccb2af8c524901934d/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:40.060003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.065439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17095e1b-a56c-4de6-9a6f-3e22d4ebf46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:40.067419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17095e1b-a56c-4de6-9a6f-3e22d4ebf46d service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.131208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 853/1719] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:40.341681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180951-4e8e-4445-bf25-a968d1363485 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.342096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180951-4e8e-4445-bf25-a968d1363485 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.342340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180951-4e8e-4445-bf25-a968d1363485 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.344573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 854/1720] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 05:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:40.354678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.355145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.355481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.375946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757627dd-411a-47af-b4be-15305b7a8efa admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.384398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.385364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.386059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.390824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.390938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:40.390938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:40.395077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:40.403407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.482913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 867/1721] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:39:40.492288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.535641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d597bbc-aca5-4707-9481-565637e53ab2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.546851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.553211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7ad14-d2ec-4fc4-822e-825900b58e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.553211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7ad14-d2ec-4fc4-822e-825900b58e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.553211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7ad14-d2ec-4fc4-822e-825900b58e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.554351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7ad14-d2ec-4fc4-822e-825900b58e1d admin admin] PATH_INFO: `/v3/projects/8cfd9ce81e7540e48df29312a7b52b04/users/a8e1c0f89fd247ccb2af8c524901934d/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.561836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7ad14-d2ec-4fc4-822e-825900b58e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfd9ce81e7540e48df29312a7b52b04, user_id=a8e1c0f89fd247ccb2af8c524901934d, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:40.568306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7ad14-d2ec-4fc4-822e-825900b58e1d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.636415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 868/1722] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:40 2022] PUT /identity/v3/projects/8cfd9ce81e7540e48df29312a7b52b04/users/a8e1c0f89fd247ccb2af8c524901934d/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:40.643758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 855/1723] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:40.662142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.662142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.662142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.664480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.666917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:40.735558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] MFA Rules not processed for user `a8e1c0f89fd247ccb2af8c524901934d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:40.735785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:40.831655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38073ae-5188-4f9a-bca6-484fab43b2e9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.867350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 869/1724] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:40.868910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.924909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.968294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.969653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.970915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.970915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.079517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abf16c-df1c-4c2f-8adb-5a1a03cf42cc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.086897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.087791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.088221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.088670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.185488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.187680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.208809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.210559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.211704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 870/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:41.212746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:41.217476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:41.231507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 856/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:41.243044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:41.249388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:41.365686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:41.388866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85350541-4457-4c7f-ae8c-047d64c117da service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.400471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fbc79-0d3f-47a0-bd22-1f4241764c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.403044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fbc79-0d3f-47a0-bd22-1f4241764c54 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.403044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fbc79-0d3f-47a0-bd22-1f4241764c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.403044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fbc79-0d3f-47a0-bd22-1f4241764c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.439537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ae74b-0e1f-459b-9cc3-4d9e3dadcec9 service glance] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.450324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.451656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.452340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.454918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.459812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:41.486492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.488630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3225-87b6-4a3a-b4bc-cac70c4d1e73 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.534842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 857/1727] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:41.560423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fbc79-0d3f-47a0-bd22-1f4241764c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.561855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fbc79-0d3f-47a0-bd22-1f4241764c54 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.596392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 871/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:42.337746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79420f5-b7cf-495a-990a-b4c32224ebc7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.341415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79420f5-b7cf-495a-990a-b4c32224ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.341415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79420f5-b7cf-495a-990a-b4c32224ebc7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.344471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 858/1729] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 05:39:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:42.353654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.353945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.354364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.411946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:42.417638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:42.435259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:42.596914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 872/1730] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:39:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:42.664244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79420f5-b7cf-495a-990a-b4c32224ebc7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.763564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c79420f5-b7cf-495a-990a-b4c32224ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:42.823702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79420f5-b7cf-495a-990a-b4c32224ebc7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.836307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.837536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.837942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.838344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.868315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:42.871042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:42.952012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 859/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:43.430080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.431773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:43.687753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9787-3031-4ac9-8dfb-b36ecd18a094 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.708378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.709163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.709447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.709719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] PATH_INFO: `/v3/users/5b0d118b333c4f84985ea5d1b2170778` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.714311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0d118b333c4f84985ea5d1b2170778)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.718643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.075593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0d118b333c4f84985ea5d1b2170778'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:44.078572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0d118b333c4f84985ea5d1b2170778'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:44.126904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.146520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.197858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27437cc6-187b-4c19-a946-f179565fe7b0 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.203068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0d118b333c4f84985ea5d1b2170778'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:44.224775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306dffd-5083-4930-8711-6ce844e02f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.230039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306dffd-5083-4930-8711-6ce844e02f25 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.230039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306dffd-5083-4930-8711-6ce844e02f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.230039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306dffd-5083-4930-8711-6ce844e02f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.244676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306dffd-5083-4930-8711-6ce844e02f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.248088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306dffd-5083-4930-8711-6ce844e02f25 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.274099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 860/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:44.293096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0d118b333c4f84985ea5d1b2170778'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:44.297655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1c902a10-786f-45e8-9a57-015909673a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0d118b333c4f84985ea5d1b2170778'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:44.320466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 873/1733] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:43 2022] DELETE /identity/v3/users/5b0d118b333c4f84985ea5d1b2170778 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:44.328874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.328874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.328874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.357547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:44.359560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.513571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd9ca-e32c-4cb1-a7fb-954b50f7be4a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.514420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd9ca-e32c-4cb1-a7fb-954b50f7be4a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.514870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd9ca-e32c-4cb1-a7fb-954b50f7be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.567225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 861/1734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:44.578280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.581324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.588549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bfdfd9ca-e32c-4cb1-a7fb-954b50f7be4a None None] MFA Rules not processed for user `e9b3debecd8c402a86fb2ad133bdd7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:44.595268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bfdfd9ca-e32c-4cb1-a7fb-954b50f7be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.799161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.851209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804580-82f8-4d70-a796-d2a3d0cf9b84 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.855592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 874/1735] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:44.858425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.859201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.860241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.869087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.871393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.875859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.876399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.891715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] MFA Rules not processed for user `fbc1fd78028a4b1c91b7ff29ecd4b6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:44.893210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.899869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.901326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.927609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 862/1736] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:45.057706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 875/1737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:46.525887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.527661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:46.546298 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.548665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:46.573301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9447934-bace-4251-81d2-ce84d5e4bdd9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.588968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.589814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.590244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.591024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] PATH_INFO: `/v3/users/3d25ee8614f544dea0a2fb5b973e83a6` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.592979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d25ee8614f544dea0a2fb5b973e83a6)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.597424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240dd7-b3fc-4278-b712-8cc2d3c0942e service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.604241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.647991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.648675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.649138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.649558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] PATH_INFO: `/v3/projects/b89716ad7c56404bbeed7a773239001e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.651213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89716ad7c56404bbeed7a773239001e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.653882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.854852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.894513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d25ee8614f544dea0a2fb5b973e83a6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:46.898744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d25ee8614f544dea0a2fb5b973e83a6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:46.903493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89716ad7c56404bbeed7a773239001e', 'request_id': 'req-ec0720a7-f947-4db1-b72c-1b704bdd718e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:46.966597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d25ee8614f544dea0a2fb5b973e83a6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.123729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89716ad7c56404bbeed7a773239001e', 'request_id': 'req-ec0720a7-f947-4db1-b72c-1b704bdd718e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.137535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89716ad7c56404bbeed7a773239001e', 'request_id': 'req-ec0720a7-f947-4db1-b72c-1b704bdd718e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.171674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] The token cache is being invalidate because project b89716ad7c56404bbeed7a773239001e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:47.172564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.173386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.175250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 863/1738] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:46 2022] DELETE /identity/v3/projects/b89716ad7c56404bbeed7a773239001e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:47.179179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:47.181959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:47.257938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d25ee8614f544dea0a2fb5b973e83a6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.258917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5adc7032-3c58-4cb4-845c-57b6dbc6ffb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d25ee8614f544dea0a2fb5b973e83a6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.289512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 876/1739] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:46 2022] DELETE /identity/v3/users/3d25ee8614f544dea0a2fb5b973e83a6 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:47.289512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:47.289512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:47.289512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:47.300462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0720a7-f947-4db1-b72c-1b704bdd718e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:47.306859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:47.308112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:47.458992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 877/1740] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:47.473630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:47.476453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:47.483283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:47.522888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:47.523558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:47.523839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:47.524111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] PATH_INFO: `/v3/users/889b720e50bc42d19bcd6f44638b2cfe` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:47.525715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] RBAC: Authorizing `identity:delete_user(user_id=889b720e50bc42d19bcd6f44638b2cfe)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:47.558868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:47.686030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2393a-5e1d-4184-b46d-84d8b5ec5cc2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:47.697345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874f35e-e9b4-427a-a064-a7690f693c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:47.698126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874f35e-e9b4-427a-a064-a7690f693c99 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:47.698410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874f35e-e9b4-427a-a064-a7690f693c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:47.698841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874f35e-e9b4-427a-a064-a7690f693c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:47.720341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874f35e-e9b4-427a-a064-a7690f693c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:47.722233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874f35e-e9b4-427a-a064-a7690f693c99 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:47.758277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 878/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:47.957760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889b720e50bc42d19bcd6f44638b2cfe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.980930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889b720e50bc42d19bcd6f44638b2cfe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:47.983148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889b720e50bc42d19bcd6f44638b2cfe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:48.072094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889b720e50bc42d19bcd6f44638b2cfe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:48.074517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:48.097849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889b720e50bc42d19bcd6f44638b2cfe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:48.107107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 864/1742] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:47 2022] DELETE /identity/v3/users/889b720e50bc42d19bcd6f44638b2cfe => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:48.286648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:48.287055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:48.287354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:48.369731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:48.372324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:48.527934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 879/1743] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:39:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:49.011918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:49.013538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:49.229383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:49.232375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:49.238866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabf61b-8cb4-4ead-a060-27723ba1191a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:49.246611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:49.247954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.248492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.248966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.263508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:49.267293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:49.284107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 865/1744] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:39:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:39:49.495185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19052-336a-4a93-b02b-081f49a3e4ee None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:49.501643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:49.504187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.504540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.504947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] PATH_INFO: `/v3/projects/7797c51149994709a3e02970149f5ba3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.511736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7797c51149994709a3e02970149f5ba3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:49.516242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:49.578643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:49.706596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:49.708361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:49.764564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10439a2f-fdc7-4bdf-8b52-cb84c4dc6c76 service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:49.808227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7797c51149994709a3e02970149f5ba3', 'request_id': 'req-0b8052a4-c7f0-4ef6-b346-3aa01387b093'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:49.923260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:49.924388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.924991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.925750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] PATH_INFO: `/v3/users/1505c9b912cc4935b54ab85b9fe14d08` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.928346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1505c9b912cc4935b54ab85b9fe14d08)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:49.930738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:49.943692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7797c51149994709a3e02970149f5ba3', 'request_id': 'req-0b8052a4-c7f0-4ef6-b346-3aa01387b093'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:49.953182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7797c51149994709a3e02970149f5ba3', 'request_id': 'req-0b8052a4-c7f0-4ef6-b346-3aa01387b093'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.023344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] The token cache is being invalidate because project 7797c51149994709a3e02970149f5ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:50.023671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.026209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.032445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 880/1745] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:49 2022] DELETE /identity/v3/projects/7797c51149994709a3e02970149f5ba3 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:50.034022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.038063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.058353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8052a4-c7f0-4ef6-b346-3aa01387b093 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.064093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.064765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.065189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.065576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] PATH_INFO: `/v3/users/4e58771e8e5d49fc8420c60804b8f7ff` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.067111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e58771e8e5d49fc8420c60804b8f7ff)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.069361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.231155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1505c9b912cc4935b54ab85b9fe14d08'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.261484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.266805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1505c9b912cc4935b54ab85b9fe14d08'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.275832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1505c9b912cc4935b54ab85b9fe14d08'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.366431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1505c9b912cc4935b54ab85b9fe14d08'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.382446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-04b8b053-a5e0-469e-a238-074a3a6a8d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1505c9b912cc4935b54ab85b9fe14d08'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.396378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 866/1746] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:49 2022] DELETE /identity/v3/users/1505c9b912cc4935b54ab85b9fe14d08 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:50.408041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.408319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.408607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.445501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e58771e8e5d49fc8420c60804b8f7ff'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.460241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e58771e8e5d49fc8420c60804b8f7ff'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.497152 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:50.501090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.519620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e58771e8e5d49fc8420c60804b8f7ff'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.623817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e58771e8e5d49fc8420c60804b8f7ff'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.625120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e58771e8e5d49fc8420c60804b8f7ff'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:50.649982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 881/1747] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:50 2022] DELETE /identity/v3/users/4e58771e8e5d49fc8420c60804b8f7ff => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:50.663902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 867/1748] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:50.716040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.717687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.783483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.786642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.815558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece882a-8548-4b98-858a-3e18ecc7516c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.166164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f335-8d4a-40c3-855f-0a6945b27482 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.166164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadb41d-5e48-46f5-9544-24383055e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.169820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.173972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadb41d-5e48-46f5-9544-24383055e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.173972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadb41d-5e48-46f5-9544-24383055e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.173972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadb41d-5e48-46f5-9544-24383055e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.176744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.176744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.176744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] PATH_INFO: `/v3/projects/be304d63099445948840e17fda7765a0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.176744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=be304d63099445948840e17fda7765a0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.176744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.179355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadb41d-5e48-46f5-9544-24383055e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.179355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadb41d-5e48-46f5-9544-24383055e0c4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.179355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 882/1749] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:51.721359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be304d63099445948840e17fda7765a0', 'request_id': 'req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:51.826316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be304d63099445948840e17fda7765a0', 'request_id': 'req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:51.841038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be304d63099445948840e17fda7765a0', 'request_id': 'req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:51.866474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] The token cache is being invalidate because project be304d63099445948840e17fda7765a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:51.869562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:51.870559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ef915a0-ee6b-4370-b64c-e4ebaf1fb3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:51.875569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 868/1750] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:50 2022] DELETE /identity/v3/projects/be304d63099445948840e17fda7765a0 => generated 0 bytes in 1093 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:51.887058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53537910-0e89-4209-9108-ece177642719 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.887618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53537910-0e89-4209-9108-ece177642719 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.888492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53537910-0e89-4209-9108-ece177642719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.973206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-53537910-0e89-4209-9108-ece177642719 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:51.976684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53537910-0e89-4209-9108-ece177642719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:52.019514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:52.064127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.064407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.065040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.156984 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:52.163835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:52.178671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:52.232971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 883/1751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:52.250120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.252623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.253015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.338996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:52.351087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:52.390031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 884/1752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:52.393795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:52.410020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 869/1753] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:52.437940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705f64-5b0b-4c1d-90ab-dd7566a7b50c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.456651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:52.458197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:52.466529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.469374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.470332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.471067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.479969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:52.485068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:52.488387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:52.501889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b977ca-d0ec-40a2-822e-bc3b9528129e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.526825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 885/1754] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:52.528055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:52.530249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:52.540723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.541410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.545187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.545586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.552531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22258-8a0a-4e06-952c-a51b89a8a1f4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.560494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.565410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.565698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.565980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.577252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:52.582876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:52.587753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:52.589337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:52.611252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 870/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:52.619542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:52.643509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 886/1756] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:52.667732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c3e5-d0e8-4d5a-9b29-b779cb396b96 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.692468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.693103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.693383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.693655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.694290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:52.696322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:52.864070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 871/1757] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:52 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:52.870033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:52.889994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb463bed-bcbc-444d-8264-5a16cd9fdb68 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.997480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.999951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.000718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.001709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.004140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:53.010951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:53.140300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 887/1758] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:52 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:53.144929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.167181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fe95-9695-4afc-b299-9b7c27efbecd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.176409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:53.177395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.191479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.191479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.191479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:53.191479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:53.196970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.197935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 872/1759] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:53.233056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1678cd-3e33-4436-bba2-100f8f179e3d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.242176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:53.244112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.244280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.253126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.254419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:53.267610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:53.297780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 888/1760] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:53.302308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.320788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c17c5-9922-4a39-9efa-903335f2cdf5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.334725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6c2dc-5b0f-4750-8136-0cd44b8429d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:53.336779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c2dc-5b0f-4750-8136-0cd44b8429d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.337322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c2dc-5b0f-4750-8136-0cd44b8429d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.338092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c2dc-5b0f-4750-8136-0cd44b8429d2 admin admin] PATH_INFO: `/v3/projects/1ce056432d2e46a79f032d7d406d693a/users/c7e9445c1ceb4cabb3a281ece7801a5a/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.398221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6c2dc-5b0f-4750-8136-0cd44b8429d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce056432d2e46a79f032d7d406d693a, user_id=c7e9445c1ceb4cabb3a281ece7801a5a, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:53.416615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6c2dc-5b0f-4750-8136-0cd44b8429d2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:53.465307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.466249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:53.501777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6f580-5f12-4eca-a8e7-236c88c5f0ab admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.511365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:53.511365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.511365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.511365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] PATH_INFO: `/v3/projects/c55a79c353da458d9ea61491db8bcd65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.517674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55a79c353da458d9ea61491db8bcd65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:53.520838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:53.536219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 873/1761] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:53 2022] PUT /identity/v3/projects/1ce056432d2e46a79f032d7d406d693a/users/c7e9445c1ceb4cabb3a281ece7801a5a/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:53.548488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.551589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.551589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.681418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] MFA Rules not processed for user `c7e9445c1ceb4cabb3a281ece7801a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:53.682871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:53.826813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55a79c353da458d9ea61491db8bcd65', 'request_id': 'req-38535810-a01a-42a6-bc06-7fb1dcd93ebb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:53.940122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55a79c353da458d9ea61491db8bcd65', 'request_id': 'req-38535810-a01a-42a6-bc06-7fb1dcd93ebb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:53.960138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55a79c353da458d9ea61491db8bcd65', 'request_id': 'req-38535810-a01a-42a6-bc06-7fb1dcd93ebb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:53.965048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:53.999328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 874/1762] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:54.001501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.003115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] The token cache is being invalidate because project c55a79c353da458d9ea61491db8bcd65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:54.003401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.005809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.007368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.013076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 889/1763] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:53 2022] DELETE /identity/v3/projects/c55a79c353da458d9ea61491db8bcd65 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:54.014360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.017722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.119560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.248847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0cef-4cb6-4f97-9364-7feae9e4c16c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.268915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.271480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.273528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.274348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] PATH_INFO: `/v3/projects/48b8b01de9684047a166283269ad2189` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.279236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b8b01de9684047a166283269ad2189)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.286918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.289099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535810-a01a-42a6-bc06-7fb1dcd93ebb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.311745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.314104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.315712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.317412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.318723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.328776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.480571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 890/1764] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:54 2022] POST /identity/v3/projects => generated 387 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:54.482041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.485745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.542806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b8b01de9684047a166283269ad2189', 'request_id': 'req-2e613ab4-54bd-40dd-b929-5708d48cc6ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.623414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b8b01de9684047a166283269ad2189', 'request_id': 'req-2e613ab4-54bd-40dd-b929-5708d48cc6ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.634869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b8b01de9684047a166283269ad2189', 'request_id': 'req-2e613ab4-54bd-40dd-b929-5708d48cc6ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.693361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] The token cache is being invalidate because project 48b8b01de9684047a166283269ad2189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:54.693755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.694612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:54.706349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 875/1765] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:54 2022] DELETE /identity/v3/projects/48b8b01de9684047a166283269ad2189 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:54.714451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.718476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.733057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d1cff-9d58-4a0c-a637-fad4b3f323c4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.912849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.913877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.914348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.914861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] PATH_INFO: `/v3/users/a8e1c0f89fd247ccb2af8c524901934d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.916363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e1c0f89fd247ccb2af8c524901934d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.923514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.956957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e613ab4-54bd-40dd-b929-5708d48cc6ec admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.962814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aaec-0522-4ff8-bf43-b2e6218b71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.964285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aaec-0522-4ff8-bf43-b2e6218b71f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.964285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aaec-0522-4ff8-bf43-b2e6218b71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.976988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aaec-0522-4ff8-bf43-b2e6218b71f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.978019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aaec-0522-4ff8-bf43-b2e6218b71f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.993012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aaec-0522-4ff8-bf43-b2e6218b71f6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.094345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 876/1766] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:54 2022] POST /identity/v3/users => generated 300 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:55.096697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.109090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.110951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.207018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:55.210737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:55.236339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 877/1767] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:55.237435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.259874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e1c0f89fd247ccb2af8c524901934d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:55.272366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e1c0f89fd247ccb2af8c524901934d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:55.289743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac106f-55bd-45c9-abbc-6a965db4dd92 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.296074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.296228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cc247-2d60-404e-84ee-8f0b2c82a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.296228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cc247-2d60-404e-84ee-8f0b2c82a6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.296948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cc247-2d60-404e-84ee-8f0b2c82a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.297512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cc247-2d60-404e-84ee-8f0b2c82a6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.298200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cc247-2d60-404e-84ee-8f0b2c82a6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.302846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cc247-2d60-404e-84ee-8f0b2c82a6fd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.306429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e1c0f89fd247ccb2af8c524901934d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:55.325773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 878/1768] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:55.326883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.327168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.327469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.366721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:55.368042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:55.377882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 879/1769] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:55.378761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.399628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75bdd-f875-466b-bcba-0ef2945fba59 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.403423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e1c0f89fd247ccb2af8c524901934d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:55.404385 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e1c0f89fd247ccb2af8c524901934d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:55.415377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.416171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.416461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.419936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] PATH_INFO: `/v3/projects/1b0f7e2e56ec44b586a6966edd09d62a/users/d0e4a7086cab4d948ef78eac1f063da5/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.434681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 891/1770] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:54 2022] DELETE /identity/v3/users/a8e1c0f89fd247ccb2af8c524901934d => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:55.436125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.439528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:55.447440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0f7e2e56ec44b586a6966edd09d62a, user_id=d0e4a7086cab4d948ef78eac1f063da5, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.451904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.555555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 880/1771] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:55 2022] PUT /identity/v3/projects/1b0f7e2e56ec44b586a6966edd09d62a/users/d0e4a7086cab4d948ef78eac1f063da5/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:55.561178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.569166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:55.599772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.620640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec940d21-0ddf-4a79-bbf0-b29e034bdec2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.786970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7536-1f6d-47f6-bbbd-21b17bd3003e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.793494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.794441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.794750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.795194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.797228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.799329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.832269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 881/1772] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:55.836675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.839685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.840374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.840821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.841172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.842101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:55.842418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.845588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.872141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea551e-d68c-4eeb-9c88-d0abab76d06e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.881463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 892/1773] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:55.886852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaaf61-511a-4d5b-9b90-72376fdd6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.888225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.888642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaaf61-511a-4d5b-9b90-72376fdd6222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.889369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaaf61-511a-4d5b-9b90-72376fdd6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.890864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaaf61-511a-4d5b-9b90-72376fdd6222 admin admin] PATH_INFO: `/v3/projects/1b0f7e2e56ec44b586a6966edd09d62a/users/d0e4a7086cab4d948ef78eac1f063da5/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.893620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaaf61-511a-4d5b-9b90-72376fdd6222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0f7e2e56ec44b586a6966edd09d62a, user_id=d0e4a7086cab4d948ef78eac1f063da5, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.914055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaaf61-511a-4d5b-9b90-72376fdd6222 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.918572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffb9a-153d-40a7-bff6-1aabbe0c7ef8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.961872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 882/1774] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:55 2022] PUT /identity/v3/projects/1b0f7e2e56ec44b586a6966edd09d62a/users/d0e4a7086cab4d948ef78eac1f063da5/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:55.984258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.985955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.986512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.034231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.035834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.036376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.036853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.037713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.040380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.064740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] MFA Rules not processed for user `d0e4a7086cab4d948ef78eac1f063da5`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:56.066106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:56.166787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 893/1775] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:55 2022] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:56.170733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.204121 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 883/1776] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:56.218926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.221349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:56.321344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.328610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967918c3-3c8e-4d7a-a2e9-bbd27e84397c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.343700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.343700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.343700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.343700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.344215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.344215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.400198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72008a48-b61a-49ba-b988-0a8b791f4478 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.459173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 894/1777] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:56 2022] POST /identity/v3/users => generated 282 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:56.463082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.505603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e9b49-a40a-45f0-b7e9-7a152f786801 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.508668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaf700-98d2-44b9-83aa-df06d943cd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.510856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaf700-98d2-44b9-83aa-df06d943cd90 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.510856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaf700-98d2-44b9-83aa-df06d943cd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.510856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaf700-98d2-44b9-83aa-df06d943cd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.517290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.518204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.518629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.519348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.520465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.522687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.535335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.567800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 895/1778] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:39:56.573378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.612002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10208e5d-ab67-4b84-9549-ca8e30442a9c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.625691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b5b5-9129-49af-8d6d-40bfcea708d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.631553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b5b5-9129-49af-8d6d-40bfcea708d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.631553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b5b5-9129-49af-8d6d-40bfcea708d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.631553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b5b5-9129-49af-8d6d-40bfcea708d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.660129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85b5b5-9129-49af-8d6d-40bfcea708d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.663808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85b5b5-9129-49af-8d6d-40bfcea708d2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.703191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 896/1779] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:56.705422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a6d1-8ad2-43f0-882b-616ba2796f46 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.705976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a6d1-8ad2-43f0-882b-616ba2796f46 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.706421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a6d1-8ad2-43f0-882b-616ba2796f46 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.707741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 897/1780] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:56.717820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a6d1-8ad2-43f0-882b-616ba2796f46 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.786461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a6d1-8ad2-43f0-882b-616ba2796f46 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.801126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.806255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.806255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.806255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] PATH_INFO: `/v3/projects/35f5aa5979c84b48bc90d6315df964c9/users/d9b1e78aaa2f46bf8b1bb7306e270893/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.815998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaf700-98d2-44b9-83aa-df06d943cd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.817979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaf700-98d2-44b9-83aa-df06d943cd90 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.852443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 884/1781] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:56.863461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e74b0-295b-4a84-a009-e34025f9b405 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.863461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e74b0-295b-4a84-a009-e34025f9b405 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.863461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e74b0-295b-4a84-a009-e34025f9b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.887768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f5aa5979c84b48bc90d6315df964c9, user_id=d9b1e78aaa2f46bf8b1bb7306e270893, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.898173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.911773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fb6e74b0-295b-4a84-a009-e34025f9b405 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:56.913674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fb6e74b0-295b-4a84-a009-e34025f9b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:57.047257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 898/1782] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:56 2022] PUT /identity/v3/projects/35f5aa5979c84b48bc90d6315df964c9/users/d9b1e78aaa2f46bf8b1bb7306e270893/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:57.049179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.126010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 885/1783] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:57.128083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a3d7-65ff-40bd-ad89-8992b84c510d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.128746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a3d7-65ff-40bd-ad89-8992b84c510d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.129181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a3d7-65ff-40bd-ad89-8992b84c510d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.132459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 886/1784] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:39:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:57.135242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.137680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.138250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.191104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] MFA Rules not processed for user `d9b1e78aaa2f46bf8b1bb7306e270893`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:57.194004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:57.322367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f93134-0d91-4474-b478-fb1813b85472 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.336156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.337850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.337850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.337850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] PATH_INFO: `/v3/users/c7e9445c1ceb4cabb3a281ece7801a5a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.339016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e9445c1ceb4cabb3a281ece7801a5a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.342061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.364697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 887/1785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:57.365715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.379447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:57.433100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.552556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.670220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e9445c1ceb4cabb3a281ece7801a5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:57.671030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e9445c1ceb4cabb3a281ece7801a5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:57.692989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457e2fd-a7ab-4bbe-a494-8c4199f596ef None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.734257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e9445c1ceb4cabb3a281ece7801a5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:57.766200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.767232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.770633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.771012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.823510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.825147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.834767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e9445c1ceb4cabb3a281ece7801a5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:57.835464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1f09c1c2-f3e1-459f-9fcf-b38563475c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e9445c1ceb4cabb3a281ece7801a5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:57.882786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 899/1786] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:39:57 2022] DELETE /identity/v3/users/c7e9445c1ceb4cabb3a281ece7801a5a => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:57.917716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84959aa-d6a5-4c25-88a9-43e1515fec82 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.921384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84959aa-d6a5-4c25-88a9-43e1515fec82 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.921384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84959aa-d6a5-4c25-88a9-43e1515fec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.930219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 888/1787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:57.932137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.023141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda60b2-425a-4c32-9c8d-2d43e65b6f5f service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.082132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e84959aa-d6a5-4c25-88a9-43e1515fec82 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:58.085331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e84959aa-d6a5-4c25-88a9-43e1515fec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.203145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.205639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.206647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.208133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.210541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.214281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.327168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 889/1788] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:57 2022] POST /identity/v3/projects => generated 365 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:58.328570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.334063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.339580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 900/1789] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:58.341208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.341644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.341923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.382181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:58.383572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.521019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938474-2d81-4e3e-88a9-4e660e6c0896 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.536629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.538682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.539181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.540254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] PATH_INFO: `/v3/projects/8cfd9ce81e7540e48df29312a7b52b04` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.556670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfd9ce81e7540e48df29312a7b52b04)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.558184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.584990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.599443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 901/1790] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:58.604243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.610103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.656825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c797c88-21eb-4220-809c-14ce76fe3931 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.671951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.672689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.673032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.674271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.676063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.681542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.806476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfd9ce81e7540e48df29312a7b52b04', 'request_id': 'req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:58.806588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 902/1791] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:58 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:58.806588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.817799 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.883401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfd9ce81e7540e48df29312a7b52b04', 'request_id': 'req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:58.891627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfd9ce81e7540e48df29312a7b52b04', 'request_id': 'req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:58.972366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] The token cache is being invalidate because project 8cfd9ce81e7540e48df29312a7b52b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:39:58.972641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:58.982503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:39:58.991915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 890/1792] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:39:58 2022] DELETE /identity/v3/projects/8cfd9ce81e7540e48df29312a7b52b04 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:58.997072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.002139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.021866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf4a2f-dd24-4d57-ad57-08ac475abb57 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.089932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:59.187778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6a1f-10c8-42d6-bf08-60ceca03dc9e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.195261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.198072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.198072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.198072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.201298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.233380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.234831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.235118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.235394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.240035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.279725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.281771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.311412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 903/1793] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:59.313046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.314821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.419376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.423630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39e52b-297e-477e-9172-ee4dd4680fbb service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.452935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 891/1794] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:59.459710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6161ba5-2bd6-48b8-a4bd-7d75e34f6b64 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.461980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6161ba5-2bd6-48b8-a4bd-7d75e34f6b64 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.465055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6161ba5-2bd6-48b8-a4bd-7d75e34f6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.517129 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f6161ba5-2bd6-48b8-a4bd-7d75e34f6b64 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:59.518491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f6161ba5-2bd6-48b8-a4bd-7d75e34f6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.521458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fbe9a-79b3-4540-8ea6-5e7c9adf856f service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.526595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.527258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.527538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.527809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.528618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.531334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.546487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 892/1795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:59.547265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 904/1796] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:39:59.551633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.551633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.551633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.552080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.575440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c139182-976e-48cb-aa87-6d635bfca394 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.578482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:59.580574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.592045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.615994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 893/1797] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:59.627765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.628062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.628348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] PATH_INFO: `/v3/projects/ea731ffa49f94c25ae9408a1e1de887d/users/5a85231a863b46038dd5b05272cb5b4c/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.630676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.646427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d9c3-8789-4f8c-a246-78da94c6910d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.661715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.662406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.662923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.663200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.663926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:59.664230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.665907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.670264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea731ffa49f94c25ae9408a1e1de887d, user_id=5a85231a863b46038dd5b05272cb5b4c, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.673979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.696799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 894/1798] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:59.706387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.741818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cda4c-9084-4ab0-9b83-b3925b9aefc0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.748798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.751218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.753423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.755598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.763721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.774597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 905/1799] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:59 2022] PUT /identity/v3/projects/ea731ffa49f94c25ae9408a1e1de887d/users/5a85231a863b46038dd5b05272cb5b4c/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:59.777289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.780240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.876817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f9d2-d543-4912-810f-dfb67eb3c07c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:59.883200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:59.884371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.885014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.885768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.886847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.888605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 895/1800] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:39:59 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:59.889132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.895721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.915809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 906/1801] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:39:59.929243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.936207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:59.990846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574c492-acb2-44c2-9ed3-ebb5585114a7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.103602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b7b76-8bc2-4440-b00f-6f5a11037796 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.111124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.111920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.112309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.112690 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.113442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.115764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.138114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f989ea1-43cd-444e-a0ba-8dcbba51bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.142473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f989ea1-43cd-444e-a0ba-8dcbba51bb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.142473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f989ea1-43cd-444e-a0ba-8dcbba51bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.142473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f989ea1-43cd-444e-a0ba-8dcbba51bb61 admin admin] PATH_INFO: `/v3/projects/ea731ffa49f94c25ae9408a1e1de887d/users/5a85231a863b46038dd5b05272cb5b4c/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.144945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f989ea1-43cd-444e-a0ba-8dcbba51bb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea731ffa49f94c25ae9408a1e1de887d, user_id=5a85231a863b46038dd5b05272cb5b4c, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.148874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f989ea1-43cd-444e-a0ba-8dcbba51bb61 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.174197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 907/1802] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:39:59 2022] PUT /identity/v3/projects/ea731ffa49f94c25ae9408a1e1de887d/users/5a85231a863b46038dd5b05272cb5b4c/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:00.178147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.178978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.178978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.240357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] MFA Rules not processed for user `5a85231a863b46038dd5b05272cb5b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:00.243552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:00.251678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 896/1803] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:39:59 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:00.255579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.274303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dbec-7eb3-4d47-8772-7a096002f016 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.421154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.421789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.422148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.422432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.423316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.425940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.430494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 908/1804] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:00.457384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.475114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 897/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:00.483681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.488210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:00.492897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f2fa-374d-4c03-9341-b6fd7613bc23 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.505069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.506638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.506977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.507263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.507981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.509987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.547002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 909/1806] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:00.556176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.574656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d137-6bc8-494a-b2bd-1aa0e9c82455 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.587907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.588763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.589060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.589334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] PATH_INFO: `/v3/projects/2c4812115cb84ec7988540b47f632c99/users/b9ada3c20676411ba37b8985f8dd0bee/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.610617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066d302-3e19-4f26-93d8-a8047f47cd0f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.617857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3183a-0ef7-4508-af1f-f4c48714a14b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.618627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3183a-0ef7-4508-af1f-f4c48714a14b service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.619271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3183a-0ef7-4508-af1f-f4c48714a14b service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.619857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3183a-0ef7-4508-af1f-f4c48714a14b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.634584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3183a-0ef7-4508-af1f-f4c48714a14b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.636540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3183a-0ef7-4508-af1f-f4c48714a14b service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.645118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4812115cb84ec7988540b47f632c99, user_id=b9ada3c20676411ba37b8985f8dd0bee, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.650808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.677512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 898/1807] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:00.723664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 910/1808] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:00 2022] PUT /identity/v3/projects/2c4812115cb84ec7988540b47f632c99/users/b9ada3c20676411ba37b8985f8dd0bee/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:00.739584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.740833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.741661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.830296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] MFA Rules not processed for user `b9ada3c20676411ba37b8985f8dd0bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:00.833725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:00.969175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.971345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.015919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 899/1809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:01.113365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.179493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdab07-3034-46b1-8bba-285ac634daef admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.189718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.190426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.190761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.191009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.198865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7f2d-890f-464e-89ba-91e5f3e7d697 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.200188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.205084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.212133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.212133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.212133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.229246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.233238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.256930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 900/1810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:01.303701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.309269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.312318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.328357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 911/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:01.360861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.363491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.534712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032213e-da31-46d9-a83c-9af61200bdd9 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.552189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.554124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.554786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.562440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] PATH_INFO: `/v3/projects/1ce056432d2e46a79f032d7d406d693a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.564280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce056432d2e46a79f032d7d406d693a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.567662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.736943 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce056432d2e46a79f032d7d406d693a', 'request_id': 'req-40aa892d-b497-4647-a215-955c619517ef'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:01.846511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce056432d2e46a79f032d7d406d693a', 'request_id': 'req-40aa892d-b497-4647-a215-955c619517ef'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:01.863022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce056432d2e46a79f032d7d406d693a', 'request_id': 'req-40aa892d-b497-4647-a215-955c619517ef'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:01.887019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] The token cache is being invalidate because project 1ce056432d2e46a79f032d7d406d693a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:01.887843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:01.889044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:01.896284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.897739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 901/1812] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:01 2022] DELETE /identity/v3/projects/1ce056432d2e46a79f032d7d406d693a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:01.909548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddc27f-a1d8-4f39-8163-1e3a7a59a08b service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.004668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.005431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.008409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.008778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] PATH_INFO: `/v3/users/d0e4a7086cab4d948ef78eac1f063da5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.010850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e4a7086cab4d948ef78eac1f063da5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.013184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.301326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e4a7086cab4d948ef78eac1f063da5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:02.303169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e4a7086cab4d948ef78eac1f063da5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:02.356815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e4a7086cab4d948ef78eac1f063da5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:02.434531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e4a7086cab4d948ef78eac1f063da5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:02.435211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2077b2d6-2fff-4b32-9c2c-23357ce97113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e4a7086cab4d948ef78eac1f063da5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:02.470846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 912/1813] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:01 2022] DELETE /identity/v3/users/d0e4a7086cab4d948ef78eac1f063da5 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:03.090933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.099079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:03.125870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa892d-b497-4647-a215-955c619517ef admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.253359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.293687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.294351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.294633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.298000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] PATH_INFO: `/v3/projects/1b0f7e2e56ec44b586a6966edd09d62a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.304081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0f7e2e56ec44b586a6966edd09d62a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.306491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.565381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0f7e2e56ec44b586a6966edd09d62a', 'request_id': 'req-bcf5233b-cc7f-4f23-962c-0f720a40f72a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:03.641163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.663291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0f7e2e56ec44b586a6966edd09d62a', 'request_id': 'req-bcf5233b-cc7f-4f23-962c-0f720a40f72a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:03.671786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0f7e2e56ec44b586a6966edd09d62a', 'request_id': 'req-bcf5233b-cc7f-4f23-962c-0f720a40f72a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:03.701136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] The token cache is being invalidate because project 1b0f7e2e56ec44b586a6966edd09d62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:03.702674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:03.704087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcf5233b-cc7f-4f23-962c-0f720a40f72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:03.707469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 902/1814] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:03 2022] DELETE /identity/v3/projects/1b0f7e2e56ec44b586a6966edd09d62a => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:03.713413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.713881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.714226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.759599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:03.763288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:03.927775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.927775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.927775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.929301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 913/1815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:03.959318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:03.962122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:03.972360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 903/1816] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:03.979750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.992891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbece4c-2951-4518-a583-1079b00e2885 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.005142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.006162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.007643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.008176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.009394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:04.009982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.012539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.026806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 914/1817] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:04.032581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.049567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4347a-0f85-43c1-ae76-b1f148ad0760 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.056327 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.057031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.057550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.057843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.058738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.061054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.179316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 904/1818] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:04 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:04.180305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.194553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26a11-5d18-4dd4-b04b-8b98de4dbe1d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.325944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.328452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.335347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.335677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.336369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.339216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.443105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.454730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 915/1819] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:04 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:04.473251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085cf92-ef75-4afa-9800-c8508a8d8cb7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.493051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.493051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.493051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.493051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.507922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.515068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.549336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 905/1820] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:04.551020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.757877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b847-edea-43a1-ae30-3e2a83c6b223 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.757877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540cf77-6274-4833-a9f2-5e866f2b0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.757877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540cf77-6274-4833-a9f2-5e866f2b0eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.757877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540cf77-6274-4833-a9f2-5e866f2b0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.761675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540cf77-6274-4833-a9f2-5e866f2b0eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.761675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540cf77-6274-4833-a9f2-5e866f2b0eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.761675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540cf77-6274-4833-a9f2-5e866f2b0eb6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.761675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 916/1821] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:04.763135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.791586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9016fe-0a07-4e6f-a0fb-38df5213970f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.800980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.807142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.807142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.807142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] PATH_INFO: `/v3/projects/4f73810d628a4fea9f43bba75dcaf970/users/1317f5ba34f64aa8813e854c9a4c8221/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.832959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f73810d628a4fea9f43bba75dcaf970, user_id=1317f5ba34f64aa8813e854c9a4c8221, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.836965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.169086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 906/1822] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:04 2022] PUT /identity/v3/projects/4f73810d628a4fea9f43bba75dcaf970/users/1317f5ba34f64aa8813e854c9a4c8221/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:05.188572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.188857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.189133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.221908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] MFA Rules not processed for user `1317f5ba34f64aa8813e854c9a4c8221`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:05.223860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:05.292456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 917/1823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:05.298230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.368352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a92680-f91b-47c6-948d-4ca72cdff31d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.373121 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.373811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.374251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.374617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.375233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.377141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.482668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 907/1824] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:05 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:05.483997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.495859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f635-3bcd-4e37-b0c9-f3cce89d49ec None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.560519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:05.565261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.565892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.566174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.566453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.567163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.569303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.656063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 918/1825] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:05 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:05.659915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.670433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734379-ab3f-42f0-b91b-1cd41f31bb84 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.675183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.675790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.676070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.676345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.676998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.678605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.690157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 908/1826] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:05.694431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.705338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2834c2-4596-4845-958f-d5e344a4b5a8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.712474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.733247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.733247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.733247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] PATH_INFO: `/v3/projects/89139d9e62d544299d4610b20e308952/users/905a33f10766438a8f8f7e871e5b43fb/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.733247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=89139d9e62d544299d4610b20e308952, user_id=905a33f10766438a8f8f7e871e5b43fb, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.733247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.785725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:05.818913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 919/1827] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:05 2022] PUT /identity/v3/projects/89139d9e62d544299d4610b20e308952/users/905a33f10766438a8f8f7e871e5b43fb/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:05.829366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.847004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ff7df-8a82-4c3b-8d07-e64aa66400f9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.939138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e40f0-4eb7-4e58-9603-ff57b4fc8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.940319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e40f0-4eb7-4e58-9603-ff57b4fc8f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.940883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e40f0-4eb7-4e58-9603-ff57b4fc8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.941385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e40f0-4eb7-4e58-9603-ff57b4fc8f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.942878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e40f0-4eb7-4e58-9603-ff57b4fc8f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.945413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e40f0-4eb7-4e58-9603-ff57b4fc8f38 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.962126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 909/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:05.972538 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.998315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac29aa-d08a-42a9-a1dc-cc3c5813e2cc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.005402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.006144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.006439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.006897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] PATH_INFO: `/v3/projects/89139d9e62d544299d4610b20e308952/users/905a33f10766438a8f8f7e871e5b43fb/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.008959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89139d9e62d544299d4610b20e308952, user_id=905a33f10766438a8f8f7e871e5b43fb, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.012076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.027889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 920/1829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:05 2022] PUT /identity/v3/projects/89139d9e62d544299d4610b20e308952/users/905a33f10766438a8f8f7e871e5b43fb/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:06.041766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.042060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.042346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.087853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] MFA Rules not processed for user `905a33f10766438a8f8f7e871e5b43fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:06.089417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:06.178105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 910/1830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:06.199480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.199480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:06.259349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d40fef-fd68-460c-8631-fd8b66382d67 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.263595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5dde4-3e3b-45a8-93ae-fd678623308c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.266477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dde4-3e3b-45a8-93ae-fd678623308c service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.266477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dde4-3e3b-45a8-93ae-fd678623308c service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.266477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dde4-3e3b-45a8-93ae-fd678623308c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.276199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5dde4-3e3b-45a8-93ae-fd678623308c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.277680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5dde4-3e3b-45a8-93ae-fd678623308c service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.297126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 921/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:06.374804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.452702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78839cbb-0cf0-41f9-a198-267c7803d4a3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.461746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.461746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.461746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.461746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] PATH_INFO: `/v3/users/1317f5ba34f64aa8813e854c9a4c8221` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.463870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1317f5ba34f64aa8813e854c9a4c8221)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.467371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.842552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1317f5ba34f64aa8813e854c9a4c8221'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:06.854141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1317f5ba34f64aa8813e854c9a4c8221'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:06.854882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1317f5ba34f64aa8813e854c9a4c8221'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:06.965583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1317f5ba34f64aa8813e854c9a4c8221'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:06.974516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1317f5ba34f64aa8813e854c9a4c8221'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:06.980739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 911/1832] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:06 2022] DELETE /identity/v3/users/1317f5ba34f64aa8813e854c9a4c8221 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:06.985473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.985970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.986103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.010086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:07.011608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:07.096501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 922/1833] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:07.110858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.112914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:07.174741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.224689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141ee0-eca8-48e5-907c-14b19ee5f268 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.228833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.229448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.229918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.230336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.243459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.244948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.256156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 912/1834] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:07.429555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.888210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.889511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:07.916084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2e34a-a9da-4c9d-ae6e-aa1366c2bf8e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.922755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.923639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.924967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.925357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] PATH_INFO: `/v3/projects/4f73810d628a4fea9f43bba75dcaf970` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.927309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f73810d628a4fea9f43bba75dcaf970)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.929763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.062316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f73810d628a4fea9f43bba75dcaf970', 'request_id': 'req-ea43c08c-6497-45e8-aa47-778c15bc1a39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.137490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f73810d628a4fea9f43bba75dcaf970', 'request_id': 'req-ea43c08c-6497-45e8-aa47-778c15bc1a39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.144909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f73810d628a4fea9f43bba75dcaf970', 'request_id': 'req-ea43c08c-6497-45e8-aa47-778c15bc1a39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.157640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] The token cache is being invalidate because project 4f73810d628a4fea9f43bba75dcaf970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:08.157979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.158733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.171783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 923/1835] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:07 2022] DELETE /identity/v3/projects/4f73810d628a4fea9f43bba75dcaf970 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:08.171925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.175510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fddc11-9a6f-4006-8afa-718fadc7ee4c service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.236224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.236869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.237148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.237422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] PATH_INFO: `/v3/users/905a33f10766438a8f8f7e871e5b43fb` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.238621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905a33f10766438a8f8f7e871e5b43fb)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.240588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.448337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905a33f10766438a8f8f7e871e5b43fb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.466017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905a33f10766438a8f8f7e871e5b43fb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.466017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905a33f10766438a8f8f7e871e5b43fb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.537060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905a33f10766438a8f8f7e871e5b43fb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.546105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6f38381b-e1ec-4133-b92e-323b6025e8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905a33f10766438a8f8f7e871e5b43fb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:08.552759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 913/1836] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:08 2022] DELETE /identity/v3/users/905a33f10766438a8f8f7e871e5b43fb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:08.565889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.806941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.184383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.187375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:09.203110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43c08c-6497-45e8-aa47-778c15bc1a39 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.268903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.269577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.269853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.270124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] PATH_INFO: `/v3/projects/89139d9e62d544299d4610b20e308952` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.271323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89139d9e62d544299d4610b20e308952)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.273249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.374930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89139d9e62d544299d4610b20e308952', 'request_id': 'req-0b8a14a1-5947-44cf-9072-6b12c9281092'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:09.482002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89139d9e62d544299d4610b20e308952', 'request_id': 'req-0b8a14a1-5947-44cf-9072-6b12c9281092'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:09.490779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89139d9e62d544299d4610b20e308952', 'request_id': 'req-0b8a14a1-5947-44cf-9072-6b12c9281092'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:09.491780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.507017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] The token cache is being invalidate because project 89139d9e62d544299d4610b20e308952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:09.507402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:09.508102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b8a14a1-5947-44cf-9072-6b12c9281092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:09.515689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 924/1837] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:09 2022] DELETE /identity/v3/projects/89139d9e62d544299d4610b20e308952 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:09.517401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50078c69-781e-484b-abd3-4c0917913380 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.517686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50078c69-781e-484b-abd3-4c0917913380 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.518264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50078c69-781e-484b-abd3-4c0917913380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.549060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-50078c69-781e-484b-abd3-4c0917913380 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:09.551175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-50078c69-781e-484b-abd3-4c0917913380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:09.635529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.635812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.636094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.640645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 914/1838] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:09.660086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:09.661382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:09.676944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.689807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 925/1839] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:09.690974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50078c69-781e-484b-abd3-4c0917913380 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.705276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50078c69-781e-484b-abd3-4c0917913380 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.716989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.717834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.718222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.718750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.719815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.720260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.722208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.740231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.741988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:09.747679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 915/1840] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.749575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.762358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9945b-0818-44c3-b7ea-38f2306bd158 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.771069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.771820 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.772171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.772505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.773255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.775655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.776510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc2d8-0785-4860-8bc6-308395ca462e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.791000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.792552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.793084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.793574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] PATH_INFO: `/v3/users/d9b1e78aaa2f46bf8b1bb7306e270893` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.798408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b1e78aaa2f46bf8b1bb7306e270893)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.804430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.927608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 916/1841] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:09 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:09.929112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.048411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6096-dfd2-45a8-b914-e306b5062194 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.049977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b1e78aaa2f46bf8b1bb7306e270893'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:10.051520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b1e78aaa2f46bf8b1bb7306e270893'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:10.058392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.059190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.059544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.059892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.060538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.063733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.090481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b1e78aaa2f46bf8b1bb7306e270893'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:11.284178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b1e78aaa2f46bf8b1bb7306e270893'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:11.285645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2c0a19e1-f0e7-4315-be8f-3c77c7d8fc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b1e78aaa2f46bf8b1bb7306e270893'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:11.292751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 917/1842] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:09 2022] POST /identity/v3/users => generated 287 bytes in 1364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:11.299382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.303906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:11.309699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 926/1843] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:09 2022] DELETE /identity/v3/users/d9b1e78aaa2f46bf8b1bb7306e270893 => generated 0 bytes in 1566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:11.315231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.315777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.316282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.322940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e992-507a-49c1-b11b-a42e8dce5c50 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.349793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:11.349793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:11.399305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.400029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.400309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.400585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.401268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.402909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.414727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 918/1844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:11.417857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.429777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 927/1845] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:11.431013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccf66f-67be-45ff-9d07-1aab876e8aef admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.436346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.437016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.437429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.437812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.438834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.440606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.440844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.442785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:11.458017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 919/1846] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:11.469781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.484894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966af32-d341-4534-8fe8-f85e6551a760 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.495750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.496447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.496715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.496990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] PATH_INFO: `/v3/projects/48ad0f41cd0a42a98737d08cf4efb61c/users/ae65ed8bf75d49f2878b39d6a9d08347/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.520642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ad0f41cd0a42a98737d08cf4efb61c, user_id=ae65ed8bf75d49f2878b39d6a9d08347, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.523404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.532301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1f34-67e0-47d7-8bf3-c32ac8b298e1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.536149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c75eb-3eae-4462-9873-54a99020633e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.536771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c75eb-3eae-4462-9873-54a99020633e service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.537075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c75eb-3eae-4462-9873-54a99020633e service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.537459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c75eb-3eae-4462-9873-54a99020633e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.547734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c75eb-3eae-4462-9873-54a99020633e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.549426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c75eb-3eae-4462-9873-54a99020633e service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.560093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 928/1847] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:11.626993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 920/1848] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:11 2022] PUT /identity/v3/projects/48ad0f41cd0a42a98737d08cf4efb61c/users/ae65ed8bf75d49f2878b39d6a9d08347/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:11.631897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.632226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.632579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.653174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:11.654460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:11.714999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 929/1849] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:11.725495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.799144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ac9f-b8ed-488e-bee6-b8eb4a211d1b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.804528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.805950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.806529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.806968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.817694 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.819333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.839492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 921/1850] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:12.135937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.141285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.156123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f607d-987f-4f2b-b871-acce0fa76a80 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.161669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.162719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.163620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.164312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] PATH_INFO: `/v3/projects/35f5aa5979c84b48bc90d6315df964c9` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.165863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f5aa5979c84b48bc90d6315df964c9)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.182726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.210167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.211341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.226964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f037-f854-423a-8d9d-fbf30e309323 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.232496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.234642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.235149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.235496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] PATH_INFO: `/v3/users/b9ada3c20676411ba37b8985f8dd0bee` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.236830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ada3c20676411ba37b8985f8dd0bee)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.239911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.472030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ada3c20676411ba37b8985f8dd0bee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.473446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f5aa5979c84b48bc90d6315df964c9', 'request_id': 'req-e865d93d-961e-447b-929b-1a5bf2ed79b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.489234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ada3c20676411ba37b8985f8dd0bee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.490167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ada3c20676411ba37b8985f8dd0bee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.494349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.561466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f5aa5979c84b48bc90d6315df964c9', 'request_id': 'req-e865d93d-961e-447b-929b-1a5bf2ed79b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.572392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f5aa5979c84b48bc90d6315df964c9', 'request_id': 'req-e865d93d-961e-447b-929b-1a5bf2ed79b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.602064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] The token cache is being invalidate because project 35f5aa5979c84b48bc90d6315df964c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:12.602625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.604186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.606032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 930/1851] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:12 2022] DELETE /identity/v3/projects/35f5aa5979c84b48bc90d6315df964c9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:12.614672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.616480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.691654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ada3c20676411ba37b8985f8dd0bee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.700659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6bb43d03-1f6b-4f1f-b514-a324f3c766db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ada3c20676411ba37b8985f8dd0bee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:12.712151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 922/1852] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:12 2022] DELETE /identity/v3/users/b9ada3c20676411ba37b8985f8dd0bee => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:12.725780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865d93d-961e-447b-929b-1a5bf2ed79b2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.729553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.730107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.730383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.770352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:12.770352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.830895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.831986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.832269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.832555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] PATH_INFO: `/v3/users/5a85231a863b46038dd5b05272cb5b4c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.835378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a85231a863b46038dd5b05272cb5b4c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.838126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.853172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 923/1853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:12.877430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.879043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.926207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.954664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4ca6-771c-4607-8b0f-536e9279a0fe None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.959736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.960513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.960855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.964654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.972821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.974491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.986370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 924/1854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:13.082262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a85231a863b46038dd5b05272cb5b4c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.083088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a85231a863b46038dd5b05272cb5b4c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.099464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a85231a863b46038dd5b05272cb5b4c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.199976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a85231a863b46038dd5b05272cb5b4c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.202007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ee68980-589e-4f17-9abb-ac5cc24d55fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a85231a863b46038dd5b05272cb5b4c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.241027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 931/1855] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:12 2022] DELETE /identity/v3/users/5a85231a863b46038dd5b05272cb5b4c => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:13.526088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.527755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:13.541486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f142e69-ebb7-4124-b06a-95bd5d4029e8 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.634231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.634231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.634231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.668099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.668757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.669046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.669326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] PATH_INFO: `/v3/projects/2c4812115cb84ec7988540b47f632c99` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.671307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4812115cb84ec7988540b47f632c99)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.673311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.715957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] MFA Rules not processed for user `ae65ed8bf75d49f2878b39d6a9d08347`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:13.718840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:13.809390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4812115cb84ec7988540b47f632c99', 'request_id': 'req-b1c1cdc8-a8c3-45c6-9913-e96586db933a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.825951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 932/1856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:13.848801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.851207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:13.902593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4812115cb84ec7988540b47f632c99', 'request_id': 'req-b1c1cdc8-a8c3-45c6-9913-e96586db933a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.912272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4812115cb84ec7988540b47f632c99', 'request_id': 'req-b1c1cdc8-a8c3-45c6-9913-e96586db933a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.941872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] The token cache is being invalidate because project 2c4812115cb84ec7988540b47f632c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:13.942349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.944400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b1c1cdc8-a8c3-45c6-9913-e96586db933a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:13.950303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 925/1857] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:13 2022] DELETE /identity/v3/projects/2c4812115cb84ec7988540b47f632c99 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:13.950517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21a1d8-3e24-4871-8463-11e8eb5975d1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.955624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b77b-5d3e-4a49-9fd1-2b283efcf0a7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.956158 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b77b-5d3e-4a49-9fd1-2b283efcf0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.956574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b77b-5d3e-4a49-9fd1-2b283efcf0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.988057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1001b77b-5d3e-4a49-9fd1-2b283efcf0a7 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:13.989582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1001b77b-5d3e-4a49-9fd1-2b283efcf0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.040984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.041738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.042725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.043399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.047199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.095734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 926/1858] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:14.104618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.105112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.105555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.130376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:14.131684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.151913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 927/1859] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:14.157849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.168729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd6a3-26a5-48de-8361-7bad19345fb1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.182590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.182590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.182590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.182936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.183031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.183031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:14.183031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.183323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.183433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.196261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 933/1860] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:14.197419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.198827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.209595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 928/1861] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:14.213112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.216383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc989f3-030b-4ce4-a25e-f71bc9dbe33f service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.225079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.225946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.226303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.226660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] PATH_INFO: `/v3/projects/ea731ffa49f94c25ae9408a1e1de887d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.232419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea731ffa49f94c25ae9408a1e1de887d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.232419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.251717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9e81-650c-46e5-bf1d-4bc6c3b66407 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.269735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.269735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.269735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.269735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.270090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.279790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.409995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea731ffa49f94c25ae9408a1e1de887d', 'request_id': 'req-0a66bbe1-02d8-4f20-988e-817996e2e8d3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:14.456641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 929/1862] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:14.461608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.551618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea731ffa49f94c25ae9408a1e1de887d', 'request_id': 'req-0a66bbe1-02d8-4f20-988e-817996e2e8d3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:14.568497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c028-2962-43d9-b5c9-0925ee1c7b66 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.578606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea731ffa49f94c25ae9408a1e1de887d', 'request_id': 'req-0a66bbe1-02d8-4f20-988e-817996e2e8d3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:14.580254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327928b-34ff-413f-bfd1-f15386ee3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.581294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327928b-34ff-413f-bfd1-f15386ee3b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.581723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327928b-34ff-413f-bfd1-f15386ee3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.583513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327928b-34ff-413f-bfd1-f15386ee3b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.585230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327928b-34ff-413f-bfd1-f15386ee3b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.588273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327928b-34ff-413f-bfd1-f15386ee3b99 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.604989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] The token cache is being invalidate because project ea731ffa49f94c25ae9408a1e1de887d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:14.605290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:14.606705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a66bbe1-02d8-4f20-988e-817996e2e8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:14.610252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 934/1863] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:14 2022] DELETE /identity/v3/projects/ea731ffa49f94c25ae9408a1e1de887d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:14.611678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8892555-6762-4880-99a0-8dc833cb0f7e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.611960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8892555-6762-4880-99a0-8dc833cb0f7e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.612235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8892555-6762-4880-99a0-8dc833cb0f7e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.614136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 935/1864] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:14.615571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfce88-6882-4627-994d-8d1a5b1b5265 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.615854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfce88-6882-4627-994d-8d1a5b1b5265 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.619193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfce88-6882-4627-994d-8d1a5b1b5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.643603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-54bfce88-6882-4627-994d-8d1a5b1b5265 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:14.644954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-54bfce88-6882-4627-994d-8d1a5b1b5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.652974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 936/1865] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:14.654204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.654561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.657768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.676205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:14.677445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.709213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 930/1866] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:14.711095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14407f52-f44f-479d-b712-de465aa11552 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.711569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14407f52-f44f-479d-b712-de465aa11552 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.712015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14407f52-f44f-479d-b712-de465aa11552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.768396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-14407f52-f44f-479d-b712-de465aa11552 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:14.783501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-14407f52-f44f-479d-b712-de465aa11552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.809625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 931/1867] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:14.809953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14407f52-f44f-479d-b712-de465aa11552 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.812286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-14407f52-f44f-479d-b712-de465aa11552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.824655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14407f52-f44f-479d-b712-de465aa11552 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.830830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.831670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.831955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.832226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.832872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 937/1868] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:14.833541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.833783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.835195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.851790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 932/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:14.851790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.853134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.855218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9b07-123f-40c3-a713-68ef3dcf30c1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.863040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.863829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.866778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.866778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.866778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:14.866778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.867756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.875675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921281-4c5a-46c4-8cda-fd5f2d4c35a8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.893186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.895367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.895367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.895367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.898511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 938/1870] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:14.899989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.912686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d72862-83ee-4579-a405-4e9895a9b23e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.915259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.918098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.918604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.918960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.919337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.919646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.920767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.922498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.940204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 933/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:14.941063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 939/1872] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:14.945520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.946156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.961679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:14.968617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352cbb-64f8-4df8-bd4f-2ef98835ee8a service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.969358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225eb77-8ee1-4c43-a595-7af47825945e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.982045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.983346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.983705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.984033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.984760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.990140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.990557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2a5eb-3b49-415e-987a-c63c7b86e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.007388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a5eb-3b49-415e-987a-c63c7b86e706 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.010068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a5eb-3b49-415e-987a-c63c7b86e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.010764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a5eb-3b49-415e-987a-c63c7b86e706 admin admin] PATH_INFO: `/v3/projects/2ffce609fd6d4f8bad85331c32ebf459/users/ebb104217f2740b78c53b397db5ecc31/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.088774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:15.092989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2a5eb-3b49-415e-987a-c63c7b86e706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffce609fd6d4f8bad85331c32ebf459, user_id=ebb104217f2740b78c53b397db5ecc31, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.121924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2a5eb-3b49-415e-987a-c63c7b86e706 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.238035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 934/1873] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/projects => generated 373 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:15.244717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.276827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 940/1874] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:14 2022] PUT /identity/v3/projects/2ffce609fd6d4f8bad85331c32ebf459/users/ebb104217f2740b78c53b397db5ecc31/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:15.278861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.279156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.284161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.318320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] MFA Rules not processed for user `ebb104217f2740b78c53b397db5ecc31`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:15.320156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.421854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16176cdf-2e4f-4eaa-a610-0e62784ad288 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.450787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 941/1875] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:15.462282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.553347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.553965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.554254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.554522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.555193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.557373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.579820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94092f-cf80-4940-b343-0e8aeab43732 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.585937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.587206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.590154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.590154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.590154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.590570 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.663252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 935/1876] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/users => generated 287 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:15.664470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.667015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.680551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad42eac-1c9d-4d12-9e77-db339589b6f1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.685493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.686735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.687020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.687302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] PATH_INFO: `/v3/users/d8f3cabdbaf74060a6a4459c4c6ab48a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.688480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f3cabdbaf74060a6a4459c4c6ab48a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.690400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.721882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 942/1877] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/projects => generated 375 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:15.722516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.788179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca89b01-1ed1-48db-9231-bd62003123b4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.796290 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.797285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.798210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.798841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.800763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.802469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.815311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 943/1878] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:15.816602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.828773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0f64-4005-4e1e-bd2a-a2957676f8fb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.834613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.835437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.835723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.835998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.836689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.839032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.884200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f3cabdbaf74060a6a4459c4c6ab48a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:15.898879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f3cabdbaf74060a6a4459c4c6ab48a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:15.899846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f3cabdbaf74060a6a4459c4c6ab48a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:15.931511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 944/1879] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:15.932447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.944415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47f11e-f01d-4bec-a800-604a4256b417 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.949449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.950091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.950369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.950660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.952025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.953909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.965720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 945/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:15.966810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.978670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18b42-2afa-40b9-8a21-e36c9b36786b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.983954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.984568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.984843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.985111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.985776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.987660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.989101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f3cabdbaf74060a6a4459c4c6ab48a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:16.000173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 946/1881] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:16.000993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f3cabdbaf74060a6a4459c4c6ab48a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:16.001605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.003746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.008746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 936/1882] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:15 2022] DELETE /identity/v3/users/d8f3cabdbaf74060a6a4459c4c6ab48a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:16.010061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.013288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.018312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98ea6-2390-4947-b745-dbe792df7345 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.082748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.083422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.085285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.085285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] PATH_INFO: `/v3/projects/7f1fd44c99014c53959411954b0a02e5/users/d6355623ef6a48548e3fa8c4f60c198b/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.085463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a31e68-ba84-4073-b9c4-2caf8c82b9ce admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.101210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d534f7-ee2a-4da7-9f68-4129d34f4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.101916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d534f7-ee2a-4da7-9f68-4129d34f4786 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.102194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d534f7-ee2a-4da7-9f68-4129d34f4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.102466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d534f7-ee2a-4da7-9f68-4129d34f4786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.103307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d534f7-ee2a-4da7-9f68-4129d34f4786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.104800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d534f7-ee2a-4da7-9f68-4129d34f4786 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.108131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1fd44c99014c53959411954b0a02e5, user_id=d6355623ef6a48548e3fa8c4f60c198b, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.111280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.116669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 937/1883] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:16.118133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.118576 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.118922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.139624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:16.140874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.151994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 938/1884] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:16.151994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.163319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67337d-ca89-4ceb-93a6-9431036fb3cb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.179517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2962-1b1e-4b96-8dbe-6bea19a236bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.180206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2962-1b1e-4b96-8dbe-6bea19a236bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.180488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2962-1b1e-4b96-8dbe-6bea19a236bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.180774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2962-1b1e-4b96-8dbe-6bea19a236bb admin admin] PATH_INFO: `/v3/projects/70126e0708444a08bcd1c506220bcf5f/users/776236b8333e47bd9a9b9da73ec0b0bd/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.196787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 947/1885] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:16 2022] PUT /identity/v3/projects/7f1fd44c99014c53959411954b0a02e5/users/d6355623ef6a48548e3fa8c4f60c198b/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:16.197814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.201345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.219821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2962-1b1e-4b96-8dbe-6bea19a236bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=70126e0708444a08bcd1c506220bcf5f, user_id=776236b8333e47bd9a9b9da73ec0b0bd, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.223731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2962-1b1e-4b96-8dbe-6bea19a236bb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.309627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d54311-508a-45a6-ad56-c564c04268af admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.314563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8cd64-a79a-4d33-a54d-3c948df2698c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.329594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cd64-a79a-4d33-a54d-3c948df2698c service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.329594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cd64-a79a-4d33-a54d-3c948df2698c service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.329594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cd64-a79a-4d33-a54d-3c948df2698c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.330026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 939/1886] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:16 2022] PUT /identity/v3/projects/70126e0708444a08bcd1c506220bcf5f/users/776236b8333e47bd9a9b9da73ec0b0bd/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:16.330026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177d68-635a-492b-804e-61ee035a09b0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.330026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177d68-635a-492b-804e-61ee035a09b0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.330026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177d68-635a-492b-804e-61ee035a09b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.349746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-63177d68-635a-492b-804e-61ee035a09b0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:16.352127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-63177d68-635a-492b-804e-61ee035a09b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.383849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8cd64-a79a-4d33-a54d-3c948df2698c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.385563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8cd64-a79a-4d33-a54d-3c948df2698c service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.396302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 948/1887] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:16.397694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.398194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.398293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.418059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 940/1888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:16.419566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.419766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.420755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] MFA Rules not processed for user `ae65ed8bf75d49f2878b39d6a9d08347`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:16.422783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.424343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.456203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] MFA Rules not processed for user `776236b8333e47bd9a9b9da73ec0b0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:16.457634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.541027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 941/1889] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:16.542202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.543915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.557637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 949/1890] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:16.558295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.574340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5615-54cd-4590-abe7-3ec9a5911ac0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.580308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.580947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.581226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.581503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.582406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.584137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.622838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208b18c-f7f5-4707-92e2-990d1230cc4f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.627681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.628322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.628794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.629382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.642166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.643862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.656275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 942/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:16.690787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 950/1892] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:16.692834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.704983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889dfea-fd73-419a-82df-d8d750b910c0 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.786489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.787145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.787429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.787706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.791163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.791163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.895687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 943/1893] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:16.899630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.912348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358df04-2d3d-4219-80c7-aa9952e7d3b0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.919694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.920915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.921193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.921476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.928594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.928594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.941911 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.948584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 951/1894] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:16.955000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d7c7-0fbe-468b-974a-46c49696b2b5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.960748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.961441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.961774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.962186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] PATH_INFO: `/v3/projects/43642ee0f79a4441b180f755cbbef39a/users/7237c60ad6344a7b892880d208e0e7a9/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.981473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43642ee0f79a4441b180f755cbbef39a, user_id=7237c60ad6344a7b892880d208e0e7a9, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.986063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.049573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.057948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.074190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 944/1895] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:16 2022] PUT /identity/v3/projects/43642ee0f79a4441b180f755cbbef39a/users/7237c60ad6344a7b892880d208e0e7a9/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:17.084871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.102789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4e52-3a65-42f1-a31b-c6c1e01ce5fa admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.195457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.225890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f13d21-7dc5-4c0b-8e6e-885ab4460433 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.253832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.253832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.253832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.253832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.254627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.259850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.288727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 945/1896] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:17.290465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.300915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.301632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.302070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.302391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] PATH_INFO: `/v3/projects/7e2138b46a3c4af29636a0daab81574d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.303845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2138b46a3c4af29636a0daab81574d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.309010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.316404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ffaf-7368-43b6-ad00-7ec061d52f60 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.332002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60fb78-8cdb-4cb1-91f9-c158ac2b6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.332856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60fb78-8cdb-4cb1-91f9-c158ac2b6703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.333136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60fb78-8cdb-4cb1-91f9-c158ac2b6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.339461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60fb78-8cdb-4cb1-91f9-c158ac2b6703 admin admin] PATH_INFO: `/v3/projects/43642ee0f79a4441b180f755cbbef39a/users/7237c60ad6344a7b892880d208e0e7a9/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.339461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60fb78-8cdb-4cb1-91f9-c158ac2b6703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43642ee0f79a4441b180f755cbbef39a, user_id=7237c60ad6344a7b892880d208e0e7a9, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.341907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60fb78-8cdb-4cb1-91f9-c158ac2b6703 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.390863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 946/1897] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:17 2022] PUT /identity/v3/projects/43642ee0f79a4441b180f755cbbef39a/users/7237c60ad6344a7b892880d208e0e7a9/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:17.394515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.395095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.395545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.460140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] MFA Rules not processed for user `7237c60ad6344a7b892880d208e0e7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:17.462195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.515312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2138b46a3c4af29636a0daab81574d', 'request_id': 'req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:17.592409 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 947/1898] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:17.611786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.619676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.669021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.677027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2138b46a3c4af29636a0daab81574d', 'request_id': 'req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:17.687521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2138b46a3c4af29636a0daab81574d', 'request_id': 'req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:17.697402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79a877-9530-4d80-bec0-a86d8b96c02e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.700632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] The token cache is being invalidate because project 7e2138b46a3c4af29636a0daab81574d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:17.701052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:17.703099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:17.705174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 952/1899] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:17 2022] DELETE /identity/v3/projects/7e2138b46a3c4af29636a0daab81574d => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:17.709664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.710681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.774221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.774887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.775166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.775429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.779491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.803957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d8cc-98b7-4f7f-a6d1-d38dc774172a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.808918 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.810473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.811350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.812603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] PATH_INFO: `/v3/users/1dd16ca73b874b718c7f75877f6477e7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.813217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd16ca73b874b718c7f75877f6477e7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.815314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.910744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.918671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc48f5-4912-47db-a9cb-01655064a765 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.948836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 948/1900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:18.030467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd16ca73b874b718c7f75877f6477e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:18.031531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd16ca73b874b718c7f75877f6477e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:18.050932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd16ca73b874b718c7f75877f6477e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:18.125940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd16ca73b874b718c7f75877f6477e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:18.129798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd16ca73b874b718c7f75877f6477e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:18.164646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 953/1901] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:17 2022] DELETE /identity/v3/users/1dd16ca73b874b718c7f75877f6477e7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:18.790682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.791243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.791591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.829403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] MFA Rules not processed for user `d6355623ef6a48548e3fa8c4f60c198b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:18.830684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.004521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 949/1902] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:19.010879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.012505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.126060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734fab1-9dfe-48f3-8b67-abc484f7ab56 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.131145 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.132038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.132501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.132965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.133788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.136299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.312822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 954/1903] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/projects => generated 371 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:19.317286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.347115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d224e-bd4d-4eaf-86ea-28081eeff8b5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.427563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.427563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.427563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.427563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.428502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.428584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.428764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.430745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.455131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d2d8b-850e-4996-8250-11e96079dfe0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.466384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.468295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.468668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.469044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] PATH_INFO: `/v3/projects/6f6553e14c3542b685d5151a98df9a7a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.470302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6553e14c3542b685d5151a98df9a7a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.472696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.505358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 950/1904] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:19.511337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.525131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e909dd3-ebbf-4fa8-87eb-4278ad61cc70 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.530352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.531149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.531428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.531696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.532336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.533956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.544462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 951/1905] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:19.548584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.558303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b882ba-36c5-4ab1-8d1e-841449e25c2b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.567248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6553e14c3542b685d5151a98df9a7a', 'request_id': 'req-96664d62-5895-4d73-a8ec-a539523c5f73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:19.618389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.619221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.619481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.619765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] PATH_INFO: `/v3/projects/a3c752d083124b36a2882e33bd8f06cc/users/4926ded36cbb4555b904e2721a368b34/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.635756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c752d083124b36a2882e33bd8f06cc, user_id=4926ded36cbb4555b904e2721a368b34, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.638385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.673912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6553e14c3542b685d5151a98df9a7a', 'request_id': 'req-96664d62-5895-4d73-a8ec-a539523c5f73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:19.681502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6553e14c3542b685d5151a98df9a7a', 'request_id': 'req-96664d62-5895-4d73-a8ec-a539523c5f73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:19.692189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] The token cache is being invalidate because project 6f6553e14c3542b685d5151a98df9a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:19.692470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:19.693144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96664d62-5895-4d73-a8ec-a539523c5f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:19.694659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 955/1906] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:19 2022] DELETE /identity/v3/projects/6f6553e14c3542b685d5151a98df9a7a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:19.699479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40a4e-0ffa-4c47-b23c-14a3fe957dcd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.699778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40a4e-0ffa-4c47-b23c-14a3fe957dcd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.700039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40a4e-0ffa-4c47-b23c-14a3fe957dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.724917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4ce40a4e-0ffa-4c47-b23c-14a3fe957dcd None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:19.726158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4ce40a4e-0ffa-4c47-b23c-14a3fe957dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.736170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 956/1907] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:19.744837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.745194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.745468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.760682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 952/1908] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:19 2022] PUT /identity/v3/projects/a3c752d083124b36a2882e33bd8f06cc/users/4926ded36cbb4555b904e2721a368b34/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:19.765468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.765933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:19.767172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.767376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.779218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.839882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59761-6a3a-47d9-a762-5c468b14a6b1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.846352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 957/1909] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:19.846712 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.847374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.847702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.847977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.848638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.850416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.852323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.861740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 953/1910] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:19.865793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.870592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911f53c-7129-4db0-9d8b-752f1a99a37a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.876744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6474c-198b-45c7-a79d-686a84029051 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.878362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.879063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.879515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.879804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.881647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:19.882002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.882459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.883784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.883954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.890019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.890019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] PATH_INFO: `/v3/projects/a3c752d083124b36a2882e33bd8f06cc/users/4926ded36cbb4555b904e2721a368b34/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.890019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c752d083124b36a2882e33bd8f06cc, user_id=4926ded36cbb4555b904e2721a368b34, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.890902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.899973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 958/1911] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:19.902669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 954/1912] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:19 2022] PUT /identity/v3/projects/a3c752d083124b36a2882e33bd8f06cc/users/4926ded36cbb4555b904e2721a368b34/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:19.910819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.923264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43061-9452-459f-9b90-2d97cbb6be4d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.990058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.990592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.990908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.991191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.991833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.993852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.130772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 959/1913] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/projects => generated 363 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:20.135928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.155581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5090a-e79e-4c50-892d-cc6ee4dfcc41 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.252814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.253901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.254193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.254492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.255154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.257407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.354919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 955/1914] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:20 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:20.360980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.376927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922187d6-a692-42e2-a5de-23d8f7e33cb8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.384442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.385100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.385643 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.385916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.386600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.388366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.400907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 960/1915] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:20.405068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.416506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4ab0-502c-4c90-9187-ab478b5c5f6a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.426843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.427485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.428127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.428575 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.429490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.430978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.432108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.442071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.444260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:20.468502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 956/1916] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:20.486162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.497582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e11dc-7914-4d7a-b160-5550a3b111b1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.508386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28456-f4b7-4200-b0b6-f13e062b9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.508386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28456-f4b7-4200-b0b6-f13e062b9190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.508386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28456-f4b7-4200-b0b6-f13e062b9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.508386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28456-f4b7-4200-b0b6-f13e062b9190 admin admin] PATH_INFO: `/v3/projects/fb8bdf9fd0174b46bd23e8bb9b0f45be/users/728dd75b784a40fca39dd56391e61905/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.525946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d28456-f4b7-4200-b0b6-f13e062b9190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8bdf9fd0174b46bd23e8bb9b0f45be, user_id=728dd75b784a40fca39dd56391e61905, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.528782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d28456-f4b7-4200-b0b6-f13e062b9190 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.564975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986956f4-d807-489b-bcec-4e49af17903d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.577342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.578016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.578301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.578639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.585137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:20.596105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 957/1917] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:20 2022] PUT /identity/v3/projects/fb8bdf9fd0174b46bd23e8bb9b0f45be/users/728dd75b784a40fca39dd56391e61905/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:20.611240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.611773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.612182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.660960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] MFA Rules not processed for user `728dd75b784a40fca39dd56391e61905`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:20.663990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:20.698256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.699495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.734930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 961/1918] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:20.837202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 958/1919] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:20.842566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.856633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0a28-5f0a-4aec-a286-4c417089cca0 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.952090 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.953743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.954299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.954649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.955652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.958321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.075838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 962/1920] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:20 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:21.077223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.089836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877266-9215-4e2a-aa36-a6c1a64041df None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.188652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.189468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.189847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.190224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.191012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.193355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.295223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 959/1921] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:21 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:21.296612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.309215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41868bd2-70cf-4607-ad13-0ec01cb790e1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.316585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.317542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.319119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.319119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.319795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.321739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.343275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.352154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 963/1922] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:21.359537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19af3-a0b6-4b1f-a776-c6785c7592e8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.364903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.365718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.366203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.366584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] PATH_INFO: `/v3/projects/4e9d147182e14e03a365435d63259164/users/326860370e61493e8065c1c4258db309/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.385740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9d147182e14e03a365435d63259164, user_id=326860370e61493e8065c1c4258db309, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.388530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.545552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 960/1923] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:21 2022] PUT /identity/v3/projects/4e9d147182e14e03a365435d63259164/users/326860370e61493e8065c1c4258db309/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:21.549986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.560426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f790b-6c17-4a29-95a7-72f8be772010 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.641428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16120956-f12d-4ef8-b604-80c619c76c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.642436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120956-f12d-4ef8-b604-80c619c76c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.642919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120956-f12d-4ef8-b604-80c619c76c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.643493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120956-f12d-4ef8-b604-80c619c76c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.644360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16120956-f12d-4ef8-b604-80c619c76c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.646069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16120956-f12d-4ef8-b604-80c619c76c60 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.658668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 964/1924] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:21.664309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.675838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6c787-a0ec-4ad2-94bf-1186da19e6c0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.681131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4cc57-c007-4836-8b52-4d3bfcd507d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.681899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4cc57-c007-4836-8b52-4d3bfcd507d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.682243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4cc57-c007-4836-8b52-4d3bfcd507d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.682638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4cc57-c007-4836-8b52-4d3bfcd507d2 admin admin] PATH_INFO: `/v3/projects/4e9d147182e14e03a365435d63259164/users/326860370e61493e8065c1c4258db309/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.685202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4cc57-c007-4836-8b52-4d3bfcd507d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9d147182e14e03a365435d63259164, user_id=326860370e61493e8065c1c4258db309, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.688940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4cc57-c007-4836-8b52-4d3bfcd507d2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.707688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.708218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.708641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.716305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 961/1925] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:21 2022] PUT /identity/v3/projects/4e9d147182e14e03a365435d63259164/users/326860370e61493e8065c1c4258db309/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:21.728710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbabcb-fa6e-4d77-8cb3-33cf762a9513 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.729437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbabcb-fa6e-4d77-8cb3-33cf762a9513 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.729872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbabcb-fa6e-4d77-8cb3-33cf762a9513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.755134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] MFA Rules not processed for user `4926ded36cbb4555b904e2721a368b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:21.756882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.769880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e9fbabcb-fa6e-4d77-8cb3-33cf762a9513 None None] MFA Rules not processed for user `326860370e61493e8065c1c4258db309`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:21.771456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e9fbabcb-fa6e-4d77-8cb3-33cf762a9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.892548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 962/1926] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:21.895970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.895970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.900291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.900414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 965/1927] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:21.902743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.906526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.917171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] MFA Rules not processed for user `d6355623ef6a48548e3fa8c4f60c198b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:21.918925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.984039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafab932-3a0b-48c1-a9d1-be04dd19c7f9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.988609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.989360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.989768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.990118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.000617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.002798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.005251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 963/1928] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:22.017749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 966/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:22.050356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.051930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:22.130413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9eb5-38f8-4d50-acd3-9ba183feb671 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.136440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.137067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.137351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.137628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.139902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:22.155699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.157437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.169430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 964/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:22.206298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.287837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.297750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7bed7-1e76-4731-8968-68384701581e service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.302352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.303142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.303962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.304394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.386754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.388304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.399135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 967/1931] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:22.578044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.989154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.005855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a732-21b6-4f83-8eb1-1203c4209820 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.012115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.012959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.014585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.014998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.017252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:23.149905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.151323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca88648-9ec9-412b-8456-2e6c55b4227e service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.172291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 965/1932] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:23.503083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.857959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.167255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.377173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.495485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.662618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.443473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.585640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4699-1c64-4d3a-b5fd-7add3e03d879 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.590604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.591494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.591728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.592646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] PATH_INFO: `/v3/users/728dd75b784a40fca39dd56391e61905` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.593914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728dd75b784a40fca39dd56391e61905)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.595955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.854897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728dd75b784a40fca39dd56391e61905'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:27.855681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728dd75b784a40fca39dd56391e61905'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:27.875196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728dd75b784a40fca39dd56391e61905'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:27.959837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728dd75b784a40fca39dd56391e61905'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:27.961086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728dd75b784a40fca39dd56391e61905'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:27.984959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 968/1933] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:27 2022] DELETE /identity/v3/users/728dd75b784a40fca39dd56391e61905 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:27.989862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.990498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.990498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.034707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:28.036003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:28.121218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 966/1934] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:28.208689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.210605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:28.304084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5037ff-de0b-48c8-ad7c-77db35ff9181 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.308961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211fbd9-bec6-4e5a-89de-6513b1298449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.309637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211fbd9-bec6-4e5a-89de-6513b1298449 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.310079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211fbd9-bec6-4e5a-89de-6513b1298449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.310894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211fbd9-bec6-4e5a-89de-6513b1298449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.321540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211fbd9-bec6-4e5a-89de-6513b1298449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.323058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211fbd9-bec6-4e5a-89de-6513b1298449 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.334728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 969/1935] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:28.406325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.692237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.880868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.895233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.896828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:28.911237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5aa39-50af-4a7a-b3f0-f3904f378982 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.917080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.918006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.918590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.919059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] PATH_INFO: `/v3/users/ebb104217f2740b78c53b397db5ecc31` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.922554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb104217f2740b78c53b397db5ecc31)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.925006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.304112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb104217f2740b78c53b397db5ecc31'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:29.331098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb104217f2740b78c53b397db5ecc31'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:29.332736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb104217f2740b78c53b397db5ecc31'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:29.449753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb104217f2740b78c53b397db5ecc31'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:29.461978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb104217f2740b78c53b397db5ecc31'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:29.472159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 967/1936] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:28 2022] DELETE /identity/v3/users/ebb104217f2740b78c53b397db5ecc31 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:29.478995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.480044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.480388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.514214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:29.516506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:29.630944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 970/1937] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:29.667394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.677369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:29.795715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcb489-7f58-4207-883a-bae5a403fa3d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.801880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.803856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.803856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.803856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.827890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.830982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.856775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 968/1938] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:29.928922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.930845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:29.971611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8eb5e-7c23-4c93-8f43-93245480b1a0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.989178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.990020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.990404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.990819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] PATH_INFO: `/v3/projects/fb8bdf9fd0174b46bd23e8bb9b0f45be` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.992122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8bdf9fd0174b46bd23e8bb9b0f45be)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.994448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.178654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8bdf9fd0174b46bd23e8bb9b0f45be', 'request_id': 'req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.250998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8bdf9fd0174b46bd23e8bb9b0f45be', 'request_id': 'req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.262777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8bdf9fd0174b46bd23e8bb9b0f45be', 'request_id': 'req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.283319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] The token cache is being invalidate because project fb8bdf9fd0174b46bd23e8bb9b0f45be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:30.283710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.284819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.286832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 971/1939] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:29 2022] DELETE /identity/v3/projects/fb8bdf9fd0174b46bd23e8bb9b0f45be => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:30.290817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.301851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517668a-97fb-45eb-b883-ea38fe0b96a4 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.337958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.378338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.379462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.380010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.380507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] PATH_INFO: `/v3/users/326860370e61493e8065c1c4258db309` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.382480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=326860370e61493e8065c1c4258db309)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.386513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.533860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.535363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:30.550269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0052-5eb1-488f-95fd-a8d0a6ba3001 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.559078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.559951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.560863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.561414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] PATH_INFO: `/v3/projects/2ffce609fd6d4f8bad85331c32ebf459` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.562537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffce609fd6d4f8bad85331c32ebf459)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.570169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.622582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326860370e61493e8065c1c4258db309'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.644519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326860370e61493e8065c1c4258db309'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.644981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326860370e61493e8065c1c4258db309'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.699871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffce609fd6d4f8bad85331c32ebf459', 'request_id': 'req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.736872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326860370e61493e8065c1c4258db309'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.745010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326860370e61493e8065c1c4258db309'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.753307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 969/1940] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:30 2022] DELETE /identity/v3/users/326860370e61493e8065c1c4258db309 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:30.794645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffce609fd6d4f8bad85331c32ebf459', 'request_id': 'req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.807708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffce609fd6d4f8bad85331c32ebf459', 'request_id': 'req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.825841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] The token cache is being invalidate because project 2ffce609fd6d4f8bad85331c32ebf459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:30.826484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.827678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:30.830455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 972/1941] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:30 2022] DELETE /identity/v3/projects/2ffce609fd6d4f8bad85331c32ebf459 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:30.837464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.837888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:30.937304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba3cd9-482e-403b-a059-bc1819dd66ff admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.943756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.944673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.945190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.945581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] PATH_INFO: `/v3/users/776236b8333e47bd9a9b9da73ec0b0bd` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.947065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776236b8333e47bd9a9b9da73ec0b0bd)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.949216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.984673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.243877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776236b8333e47bd9a9b9da73ec0b0bd'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:31.258929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776236b8333e47bd9a9b9da73ec0b0bd'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:31.259772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776236b8333e47bd9a9b9da73ec0b0bd'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:31.371362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776236b8333e47bd9a9b9da73ec0b0bd'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:31.373830 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776236b8333e47bd9a9b9da73ec0b0bd'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:31.388182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 970/1942] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:30 2022] DELETE /identity/v3/users/776236b8333e47bd9a9b9da73ec0b0bd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:31.652822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.657418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:31.729414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee553a6-9def-4e2d-9cab-7b51e8745b8a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.766775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.790667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.791343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.791619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.791888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] PATH_INFO: `/v3/projects/4e9d147182e14e03a365435d63259164` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.793064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9d147182e14e03a365435d63259164)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.795514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.915996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9d147182e14e03a365435d63259164', 'request_id': 'req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:31.987428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.988999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:32.004442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e14a1f-5e04-492c-9493-c1b4cd537aa9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.005826 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9d147182e14e03a365435d63259164', 'request_id': 'req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.014661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9d147182e14e03a365435d63259164', 'request_id': 'req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.026456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] The token cache is being invalidate because project 4e9d147182e14e03a365435d63259164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:32.026788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.027603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b668e0a-42cd-4b61-b2e0-5b71a329dfc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.029147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 973/1943] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:31 2022] DELETE /identity/v3/projects/4e9d147182e14e03a365435d63259164 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:32.034511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110779ad-847a-4a8f-99d2-d85633658395 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.034819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110779ad-847a-4a8f-99d2-d85633658395 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.035095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110779ad-847a-4a8f-99d2-d85633658395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.055166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-110779ad-847a-4a8f-99d2-d85633658395 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:32.056620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-110779ad-847a-4a8f-99d2-d85633658395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:32.066049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.066777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.067059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.067333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] PATH_INFO: `/v3/projects/70126e0708444a08bcd1c506220bcf5f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.068463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70126e0708444a08bcd1c506220bcf5f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.070397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.119617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 974/1944] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:32.128609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.128891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.129164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.151394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:32.152443 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:32.160788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 975/1945] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:32.165347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.174853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dbae-e8aa-4542-b90c-1ee7c4295526 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.179671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.180284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.180574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.180844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.181509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:32.181810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.183470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.195034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.198532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 976/1946] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:32.203491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.203950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70126e0708444a08bcd1c506220bcf5f', 'request_id': 'req-b2074537-868f-4656-a9db-88b73a322171'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.213660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1885-3e04-44ae-afc0-c840d4f32289 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.269069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70126e0708444a08bcd1c506220bcf5f', 'request_id': 'req-b2074537-868f-4656-a9db-88b73a322171'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.276012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.276634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.276911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.277190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.277834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.279214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70126e0708444a08bcd1c506220bcf5f', 'request_id': 'req-b2074537-868f-4656-a9db-88b73a322171'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.281000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.292601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] The token cache is being invalidate because project 70126e0708444a08bcd1c506220bcf5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:32.292922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.293565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.295502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 971/1947] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:31 2022] DELETE /identity/v3/projects/70126e0708444a08bcd1c506220bcf5f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:32.299252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.300701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:32.313962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074537-868f-4656-a9db-88b73a322171 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.321212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.321212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.321212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.321212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] PATH_INFO: `/v3/users/7237c60ad6344a7b892880d208e0e7a9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.321607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7237c60ad6344a7b892880d208e0e7a9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.323548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.367342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 977/1948] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:32 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:32.371335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.372943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:32.436702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce0563-630f-4e8a-85f5-acd9130335c9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.441664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.444723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.444723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.444723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.444723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.445412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.545817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 978/1949] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:32 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:32.550354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.557504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7237c60ad6344a7b892880d208e0e7a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.582035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7237c60ad6344a7b892880d208e0e7a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.584910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48671b1-d465-4e45-b45b-7d3126703975 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.586927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7237c60ad6344a7b892880d208e0e7a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.604852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.605778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.611829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.611829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.615548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.617246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.642231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 979/1950] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:32.647473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.660927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0e7f7-9890-45ef-b398-adf3f8ca242c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.668842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.669775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.670932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.671218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.671895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.673988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.689613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 980/1951] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:32.694348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.706251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bab5f2-3030-4f20-9797-5b99269e96ef admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.712921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.713613 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.713892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.714159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] PATH_INFO: `/v3/projects/e161f61a32be4da785d9b4d4ef2a56de/users/9befc8c521bb4d3195fd8cfc15286a82/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.726652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7237c60ad6344a7b892880d208e0e7a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.734576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e161f61a32be4da785d9b4d4ef2a56de, user_id=9befc8c521bb4d3195fd8cfc15286a82, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.738311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.746616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c8aeb1c-84d7-4c96-b3a0-dd31a07203b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7237c60ad6344a7b892880d208e0e7a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:32.756263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 972/1952] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:32 2022] DELETE /identity/v3/users/7237c60ad6344a7b892880d208e0e7a9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:32.843610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 981/1953] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:32 2022] PUT /identity/v3/projects/e161f61a32be4da785d9b4d4ef2a56de/users/9befc8c521bb4d3195fd8cfc15286a82/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:32.856965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.858111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.859056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.872628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.907276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] MFA Rules not processed for user `9befc8c521bb4d3195fd8cfc15286a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:32.909074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:33.019218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 973/1954] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:33.024521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.026838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:33.126390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d7c4-c18a-441e-8b0e-4d1245ceb11f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.131587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.132223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.132505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.132810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.133488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.135504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.308239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 982/1955] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:33 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:33.309576 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.320767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:33.322461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095b57-41ec-4e1f-a914-d3b8a66b7779 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.415099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.415727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.416016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.416286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.417007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.418986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.459427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.461554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:33.478636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae6a61-d5a7-4d71-8c8b-8c8134f1477a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.493625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.494903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.495327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.495851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] PATH_INFO: `/v3/projects/43642ee0f79a4441b180f755cbbef39a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.499165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43642ee0f79a4441b180f755cbbef39a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.503519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.550710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 974/1956] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:33 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:33.555089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.566092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202906ba-4ce7-4116-b27b-2b4551c8baf1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.576859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.577513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.577805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.578320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.579038 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.589599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.594050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 975/1957] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:33.599348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.621484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a05d-c2cb-4c23-9de2-be56017f3154 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.621484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.621484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.621484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.622184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] PATH_INFO: `/v3/projects/f1815066561441c38f6418c33d4a58ec/users/ecd1b4655a3940a2b7b309bada633bbe/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.638135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1815066561441c38f6418c33d4a58ec, user_id=ecd1b4655a3940a2b7b309bada633bbe, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.651139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.764050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 976/1958] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:33 2022] PUT /identity/v3/projects/f1815066561441c38f6418c33d4a58ec/users/ecd1b4655a3940a2b7b309bada633bbe/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:33.770623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.782912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43642ee0f79a4441b180f755cbbef39a', 'request_id': 'req-b7741113-905d-4853-94f1-9bf16339830c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:33.886444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43642ee0f79a4441b180f755cbbef39a', 'request_id': 'req-b7741113-905d-4853-94f1-9bf16339830c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:33.890281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cead10-697b-4bf9-8fcc-b8e4a2421fa8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.903395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43642ee0f79a4441b180f755cbbef39a', 'request_id': 'req-b7741113-905d-4853-94f1-9bf16339830c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:33.939037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] The token cache is being invalidate because project 43642ee0f79a4441b180f755cbbef39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:33.939388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:33.940146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b7741113-905d-4853-94f1-9bf16339830c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:33.942010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 983/1959] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:33 2022] DELETE /identity/v3/projects/43642ee0f79a4441b180f755cbbef39a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:33.946810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78ea52-a557-45d7-91a7-729b93e2ddfc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.949352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78ea52-a557-45d7-91a7-729b93e2ddfc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.949352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78ea52-a557-45d7-91a7-729b93e2ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.970592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4d78ea52-a557-45d7-91a7-729b93e2ddfc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:33.971998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4d78ea52-a557-45d7-91a7-729b93e2ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:34.009985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.011180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.011842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.012125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.013670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.019347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.049586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 977/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:34.056016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 984/1961] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:34.056824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.059863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:34.070747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.071039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.071347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.076468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdcd4e-bdbd-4d59-ac12-6a19c919fa67 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.081736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bb93b-41d9-4f32-aa9d-e00504b53065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.082505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bb93b-41d9-4f32-aa9d-e00504b53065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.082887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bb93b-41d9-4f32-aa9d-e00504b53065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.083245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bb93b-41d9-4f32-aa9d-e00504b53065 admin admin] PATH_INFO: `/v3/projects/f1815066561441c38f6418c33d4a58ec/users/ecd1b4655a3940a2b7b309bada633bbe/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.085265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bb93b-41d9-4f32-aa9d-e00504b53065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1815066561441c38f6418c33d4a58ec, user_id=ecd1b4655a3940a2b7b309bada633bbe, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.088019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bb93b-41d9-4f32-aa9d-e00504b53065 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.099752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 978/1962] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:34 2022] PUT /identity/v3/projects/f1815066561441c38f6418c33d4a58ec/users/ecd1b4655a3940a2b7b309bada633bbe/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:34.101311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:34.103001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:34.110877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.111386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.111729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.142225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] MFA Rules not processed for user `ecd1b4655a3940a2b7b309bada633bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:34.143557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:34.187151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 985/1963] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:34.191498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.202920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c2a25-bfde-4428-bc08-cab1cb5f7511 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.207948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.208564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.209061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.209180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.209861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:34.210303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.212232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.230257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 979/1964] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:34.231861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 986/1965] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:34.236884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.246536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.249351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:34.251976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c718c-6dd5-4972-b497-ba699f507e97 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.257514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.258201 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.258331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.258754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.259396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.261900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.274837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:34.336384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143ce5-ae32-45c3-a3a6-b65fcee02a2c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.340777 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.342459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.343275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.343692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.362486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.364474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.384586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 987/1966] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:34.397091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 980/1967] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:34 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:34.401451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.415110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c847-e23e-4a89-bafd-73341a053721 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.497431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:34.500156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.500784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.501063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.501332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.501993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.504221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.651639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 988/1968] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:34 2022] POST /identity/v3/users => generated 284 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:34.657293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.670893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbef99a-feed-4f60-b1e0-88dae118575e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.678089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.678978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.679318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.679762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.681148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.682780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.696036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 981/1969] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:34.700407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.712868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f16ae-34ed-4366-9b8f-9642ba101e45 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.720170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb679cb-0e8f-4686-a626-7c983f196969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.720897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb679cb-0e8f-4686-a626-7c983f196969 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.721187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb679cb-0e8f-4686-a626-7c983f196969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.721462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb679cb-0e8f-4686-a626-7c983f196969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.722180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb679cb-0e8f-4686-a626-7c983f196969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.723902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb679cb-0e8f-4686-a626-7c983f196969 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.736139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 989/1970] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:34.740464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.751937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01cc1d-a1f7-4f28-bd60-5fddad1a5cfa admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.757017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.757779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.758168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.758516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] PATH_INFO: `/v3/projects/8f7d0f891ef5459c84adccd3139acc38/users/c0865f4beb384fb782477b0b8a21d8fe/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.778152 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7d0f891ef5459c84adccd3139acc38, user_id=c0865f4beb384fb782477b0b8a21d8fe, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.783244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.919363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 982/1971] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:34 2022] PUT /identity/v3/projects/8f7d0f891ef5459c84adccd3139acc38/users/c0865f4beb384fb782477b0b8a21d8fe/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:34.929425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.929711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.929984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.958834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] MFA Rules not processed for user `c0865f4beb384fb782477b0b8a21d8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:34.960046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:35.026415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 990/1972] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:35.037912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.039851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:35.102501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f827-d8cc-4ed7-9f5d-1deaf7015100 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.110843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.111492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.111774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.112049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.122080 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.123630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.134598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 983/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:35.801364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.872075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4c528-acad-498a-a9d0-67937c12c50f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.877004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecd1b4655a3940a2b7b309bada633bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1815066561441c38f6418c33d4a58ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.878381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.878381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.878381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.878871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:35.879178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.880819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.893522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 991/1974] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:35.897630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.911946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c617f-60e8-4dac-bebd-99066abd03eb service glance] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.917415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecd1b4655a3940a2b7b309bada633bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1815066561441c38f6418c33d4a58ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.918105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.918461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.918845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.919481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.922187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.013940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 984/1975] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:35 2022] POST /identity/v3/projects => generated 354 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:36.018414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.029164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f79c96-9540-49eb-be26-f712798178d1 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.097767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecd1b4655a3940a2b7b309bada633bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1815066561441c38f6418c33d4a58ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.099642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.099642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.099642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.099889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.100046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.101758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.116472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 992/1976] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:36.156769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.168215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13036b71-87ec-44b6-a359-72c61a631f43 tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.174071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecd1b4655a3940a2b7b309bada633bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1815066561441c38f6418c33d4a58ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.174798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.175083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.175364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] PATH_INFO: `/v3/projects/7151045a37094d2482e89677b47c6358` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.176639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7151045a37094d2482e89677b47c6358)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.178547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.352036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7151045a37094d2482e89677b47c6358', 'request_id': 'req-e5e821ba-8789-4c3e-8c48-4868a684f5ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:36.453213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7151045a37094d2482e89677b47c6358', 'request_id': 'req-e5e821ba-8789-4c3e-8c48-4868a684f5ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:36.467895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7151045a37094d2482e89677b47c6358', 'request_id': 'req-e5e821ba-8789-4c3e-8c48-4868a684f5ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:36.486555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] The token cache is being invalidate because project 7151045a37094d2482e89677b47c6358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:36.487136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:36.488231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e5e821ba-8789-4c3e-8c48-4868a684f5ce tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:36.490276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 985/1977] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:36 2022] DELETE /identity/v3/projects/7151045a37094d2482e89677b47c6358 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:37.505191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:37.507360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:37.587916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d55719-5747-409e-8a89-b5eaac76d8bc tempest-VolumeQuotaClassesTest-323986649 tempest-VolumeQuotaClassesTest-323986649-project-admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:37.654905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:37.655579 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:37.655885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:37.656158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] PATH_INFO: `/v3/users/9befc8c521bb4d3195fd8cfc15286a82` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:37.658936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9befc8c521bb4d3195fd8cfc15286a82)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:37.661020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:37.664544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:37.854353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9befc8c521bb4d3195fd8cfc15286a82'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:37.855077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9befc8c521bb4d3195fd8cfc15286a82'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:37.869355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9befc8c521bb4d3195fd8cfc15286a82'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:38.012196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9befc8c521bb4d3195fd8cfc15286a82'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:38.022300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9befc8c521bb4d3195fd8cfc15286a82'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:38.031160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 993/1978] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:37 2022] DELETE /identity/v3/users/9befc8c521bb4d3195fd8cfc15286a82 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:38.036788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.040164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.040513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.069166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:38.070362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:38.141463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 986/1979] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:38.151345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:38.153595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:38.177181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:38.219493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f581966-9a1c-4e56-b969-eb7808bcfa47 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:38.226501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:38.227167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.227444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.227711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.237831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:38.239336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:38.250248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 994/1980] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:38.694568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:38.696141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:38.712075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255fbdb-a33a-4c47-8a39-f6e337dcab9c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:38.717907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:38.718932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.720237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.720688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] PATH_INFO: `/v3/projects/e161f61a32be4da785d9b4d4ef2a56de` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.722508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e161f61a32be4da785d9b4d4ef2a56de)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:38.725738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:38.890729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e161f61a32be4da785d9b4d4ef2a56de', 'request_id': 'req-c16ff0ad-89a5-4a4d-994c-107769b4ff99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.023328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e161f61a32be4da785d9b4d4ef2a56de', 'request_id': 'req-c16ff0ad-89a5-4a4d-994c-107769b4ff99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.035031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e161f61a32be4da785d9b4d4ef2a56de', 'request_id': 'req-c16ff0ad-89a5-4a4d-994c-107769b4ff99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.046923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] The token cache is being invalidate because project e161f61a32be4da785d9b4d4ef2a56de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:39.047652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.048262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.050165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 987/1981] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:38 2022] DELETE /identity/v3/projects/e161f61a32be4da785d9b4d4ef2a56de => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:39.055468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.067363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1304b3-55cf-4fc9-b53c-380356a298eb service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.137284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:39.137988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.138308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.139165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] PATH_INFO: `/v3/users/ecd1b4655a3940a2b7b309bada633bbe` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.140853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd1b4655a3940a2b7b309bada633bbe)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:39.143087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:39.392381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd1b4655a3940a2b7b309bada633bbe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.393425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd1b4655a3940a2b7b309bada633bbe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.407819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd1b4655a3940a2b7b309bada633bbe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.485606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd1b4655a3940a2b7b309bada633bbe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.486682 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1022d437-5275-4488-9574-ab657618a926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd1b4655a3940a2b7b309bada633bbe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:39.506236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 995/1982] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:39 2022] DELETE /identity/v3/users/ecd1b4655a3940a2b7b309bada633bbe => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:39.858799 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.091436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.094179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:40.098813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.110492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ff0ad-89a5-4a4d-994c-107769b4ff99 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.191616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.192284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.192565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.193019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] PATH_INFO: `/v3/projects/f1815066561441c38f6418c33d4a58ec` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.194418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1815066561441c38f6418c33d4a58ec)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.196852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.310544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1815066561441c38f6418c33d4a58ec', 'request_id': 'req-8336b580-82e9-4798-abeb-7cd649e920ee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:40.388886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1815066561441c38f6418c33d4a58ec', 'request_id': 'req-8336b580-82e9-4798-abeb-7cd649e920ee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:40.397916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1815066561441c38f6418c33d4a58ec', 'request_id': 'req-8336b580-82e9-4798-abeb-7cd649e920ee'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:40.416044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] The token cache is being invalidate because project f1815066561441c38f6418c33d4a58ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:40.416529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:40.417395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8336b580-82e9-4798-abeb-7cd649e920ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:40.423323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 988/1983] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:40 2022] DELETE /identity/v3/projects/f1815066561441c38f6418c33d4a58ec => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:40.425203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.425750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.425846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.454543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:40.456545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:40.598303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 996/1984] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:40.616565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.617681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.618756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.648746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:40.648746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:40.653142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 989/1985] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:40.658334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.671471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974456f-7b59-42d5-a677-a5f6cd6ce5e7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.678835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.678835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.678835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.678835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.679592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:40.680003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.681879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.700793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 997/1986] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:40.705856 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.716235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1c2a-4124-476a-9b86-2cc3708dea9a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.729185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.730506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.731092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.731468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.732545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.735268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.889270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 990/1987] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:40 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:40.897758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.909849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1ea1-2cae-405a-bafe-27461166a09e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.004841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.005597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.006143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.006483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.007346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.009681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.221141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 998/1988] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:40 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:41.225227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.237920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca380-b4e2-43ac-882a-a0db21d70622 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.246200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.247246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.247605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.248609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.249388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.251325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.263275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 991/1989] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:41.267931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.280398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b507b-c0ef-441a-9bb7-a5ea03d2bc2c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.285982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99060ffe-adf2-445b-b216-208e73cb19c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.286720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99060ffe-adf2-445b-b216-208e73cb19c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.291123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99060ffe-adf2-445b-b216-208e73cb19c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.291123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99060ffe-adf2-445b-b216-208e73cb19c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.291123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99060ffe-adf2-445b-b216-208e73cb19c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.291123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99060ffe-adf2-445b-b216-208e73cb19c4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.303719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 999/1990] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:41.307682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.319130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda457-27b4-4ca8-a8d6-bcdd40a54579 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.324890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.326671 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.327259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.327716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] PATH_INFO: `/v3/projects/10ab19ec73934c4dbdac4f9596b0b65a/users/f6c48c44eb2e46e98f4d20260809baf0/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.355395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ab19ec73934c4dbdac4f9596b0b65a, user_id=f6c48c44eb2e46e98f4d20260809baf0, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.359943 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.496880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 992/1991] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:41 2022] PUT /identity/v3/projects/10ab19ec73934c4dbdac4f9596b0b65a/users/f6c48c44eb2e46e98f4d20260809baf0/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:41.509108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.509612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.509704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.544035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] MFA Rules not processed for user `f6c48c44eb2e46e98f4d20260809baf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:41.545340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:41.660210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1000/1992] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:41.660981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.759852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd267-5138-4622-bf02-2ebd74bba5ce admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.772309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.773280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.773711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.774151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.774962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.777412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.973002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 993/1993] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:41 2022] POST /identity/v3/projects => generated 383 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:41.976431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.994850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c710144-300f-4eaa-9bc0-13c635a3f3a5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.117470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:42.132684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.133450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.133830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.134361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.135252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.137690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.280806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:42.390974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1001/1994] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:41 2022] POST /identity/v3/users => generated 298 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:42.399929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.413343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38946-771d-4f62-a9c2-7d61398940e3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.418240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.418895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.419338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.421441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.422276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.424115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.437897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 994/1995] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:42.448405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.464693 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c77fb-32e3-4a81-8c90-ff02d0068f08 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.472242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.472951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.473293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.473664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] PATH_INFO: `/v3/projects/1f5729fce3244db5906ebb5f38c2337c/users/ab2dbf3817fd4dc195d7a133069661a7/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.498881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5729fce3244db5906ebb5f38c2337c, user_id=ab2dbf3817fd4dc195d7a133069661a7, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.504200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.641454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1002/1996] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:42 2022] PUT /identity/v3/projects/1f5729fce3244db5906ebb5f38c2337c/users/ab2dbf3817fd4dc195d7a133069661a7/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:42.645675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.663641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7ead-e17e-49b5-8010-0eade51fcd4d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.777953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96691135-0ddf-457e-a199-27430fa5819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.783168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691135-0ddf-457e-a199-27430fa5819a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.783713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691135-0ddf-457e-a199-27430fa5819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.784137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691135-0ddf-457e-a199-27430fa5819a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.785001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96691135-0ddf-457e-a199-27430fa5819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.786912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96691135-0ddf-457e-a199-27430fa5819a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.802171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 995/1997] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:42.807284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.840739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f48e65-32fe-419a-900a-a04f2976702e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.847634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.848604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.848886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.849268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] PATH_INFO: `/v3/projects/1f5729fce3244db5906ebb5f38c2337c/users/ab2dbf3817fd4dc195d7a133069661a7/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.851236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5729fce3244db5906ebb5f38c2337c, user_id=ab2dbf3817fd4dc195d7a133069661a7, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.854042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.865833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1003/1998] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:42 2022] PUT /identity/v3/projects/1f5729fce3244db5906ebb5f38c2337c/users/ab2dbf3817fd4dc195d7a133069661a7/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:42.877883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.878168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.878449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.913893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] MFA Rules not processed for user `ab2dbf3817fd4dc195d7a133069661a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:42.916441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:43.003367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 996/1999] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:43.018109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:43.026189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:43.105716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164dcf-dcd4-4a9e-87d6-50fa0fc26f63 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:43.112202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:43.113485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.113846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.114193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.128436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:43.133324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:43.161085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1004/2000] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:43.359212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:43.373572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815042e-afed-4e7a-8fa4-89d8f345a250 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:43.378135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:43.378850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.379184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.379470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.468680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:43.472455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:43.487674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 997/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:43.574276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:43.641923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.219159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.220595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:44.291963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c612-470e-4015-9523-e8934ea7039a service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.307648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.309337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.309691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.310053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] PATH_INFO: `/v3/users/53a8b24fc774472da9687505b0ec0c9f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.311845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a8b24fc774472da9687505b0ec0c9f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.314058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.548557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a8b24fc774472da9687505b0ec0c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:44.549253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a8b24fc774472da9687505b0ec0c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:44.563302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a8b24fc774472da9687505b0ec0c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:44.652625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a8b24fc774472da9687505b0ec0c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:44.657316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a8b24fc774472da9687505b0ec0c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:44.681316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1005/2002] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:44 2022] DELETE /identity/v3/users/53a8b24fc774472da9687505b0ec0c9f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:45.012865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.015246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.017713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:45.037585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72d53-51e5-429f-b8cf-b53b8fd21868 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.159430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.160472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.161053 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.162022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.166675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:45.250074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.253907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.254726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:45.255422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd1b8d-f7b5-4221-90b9-b3aa314409a5 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.269032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 998/2003] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:45.349029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06491-43a6-4168-b8f1-84b61e350fa4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.354499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.355480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.355815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.356071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] PATH_INFO: `/v3/projects/ca4408375d10434db0a11c0061357834` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.358430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4408375d10434db0a11c0061357834)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.360719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.502662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4408375d10434db0a11c0061357834', 'request_id': 'req-b4d2f06a-6866-401f-aa0f-10f5781d6815'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:45.571431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4408375d10434db0a11c0061357834', 'request_id': 'req-b4d2f06a-6866-401f-aa0f-10f5781d6815'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:45.579577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.585825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4408375d10434db0a11c0061357834', 'request_id': 'req-b4d2f06a-6866-401f-aa0f-10f5781d6815'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:45.609774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] The token cache is being invalidate because project ca4408375d10434db0a11c0061357834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:45.610561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:45.613333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4d2f06a-6866-401f-aa0f-10f5781d6815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:45.615810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1006/2004] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:45 2022] DELETE /identity/v3/projects/ca4408375d10434db0a11c0061357834 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:45.622436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.623287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.623569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.651152 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:45.652988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:45.740322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 999/2005] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:45.756865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.757378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.757874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.783813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:45.785011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:45.794036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1007/2006] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:45.800562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.813291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc07f-2772-424a-b2fa-7570076a59fd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.818471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.819189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.819536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.819810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.820471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:45.820980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.823716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.840004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1000/2007] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:45.845374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.855010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318e059-eaf4-498b-ab6a-cdeba937aa8f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.860902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.861508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.861863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.862186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.862857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.865778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.992887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1008/2008] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:45 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:45.998912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.018501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff3f5-793b-4923-b7a6-8b3feddf17bb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.110203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.115423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.115423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.115423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.115423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.115423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.245202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1001/2009] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:45 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:46.251970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.272154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaf1e-b36c-4a53-b1e6-23288e2d9e18 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.279552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.280099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.280664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.281059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.281727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.283418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.296495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1009/2010] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:46.301469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.314945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d75e-7a33-47d7-977e-25400357b977 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.320603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40acaa-72de-4f02-ac02-a1188581182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.321495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40acaa-72de-4f02-ac02-a1188581182a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.321829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40acaa-72de-4f02-ac02-a1188581182a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.322108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40acaa-72de-4f02-ac02-a1188581182a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.322787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40acaa-72de-4f02-ac02-a1188581182a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.324492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40acaa-72de-4f02-ac02-a1188581182a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.337850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1002/2011] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:46.346204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.369844 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ecf26-2bbd-4f55-b66f-83b7164d93c6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.384590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.384986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.385602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.386086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] PATH_INFO: `/v3/projects/6ba6e126e82649fd97faa737d33dafea/users/1e7b37a53a2644c5b4e75c6eb06792a1/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.411736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba6e126e82649fd97faa737d33dafea, user_id=1e7b37a53a2644c5b4e75c6eb06792a1, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.418873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.567465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1010/2012] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:46 2022] PUT /identity/v3/projects/6ba6e126e82649fd97faa737d33dafea/users/1e7b37a53a2644c5b4e75c6eb06792a1/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:46.572452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.572754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.573009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.594499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:46.595801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:46.668467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1003/2013] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:46.678611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.680390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:46.745951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937978e5-57d2-4f74-b3ab-facb13839e3c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.750215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50570e95-44ac-4148-b00b-e18b4dda843e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.750882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570e95-44ac-4148-b00b-e18b4dda843e service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.751239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570e95-44ac-4148-b00b-e18b4dda843e service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.751523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570e95-44ac-4148-b00b-e18b4dda843e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.762153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50570e95-44ac-4148-b00b-e18b4dda843e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.764674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50570e95-44ac-4148-b00b-e18b4dda843e service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.772715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.778386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1011/2014] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:46.823157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.957311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.960560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:46.981630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291132d0-4bb5-4f59-b5e0-9c67000aeaae None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.987487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.988305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.988588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.988859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] PATH_INFO: `/v3/users/f6c48c44eb2e46e98f4d20260809baf0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.990041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c48c44eb2e46e98f4d20260809baf0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.992013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:47.167265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f149098-6567-4bfa-b74f-81910522328d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:47.167265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f149098-6567-4bfa-b74f-81910522328d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:47.167534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f149098-6567-4bfa-b74f-81910522328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:47.199812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6f149098-6567-4bfa-b74f-81910522328d None None] MFA Rules not processed for user `ae65ed8bf75d49f2878b39d6a9d08347`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:47.201747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6f149098-6567-4bfa-b74f-81910522328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:47.261912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1012/2015] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:47.740097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c48c44eb2e46e98f4d20260809baf0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:47.756944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c48c44eb2e46e98f4d20260809baf0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:47.757689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c48c44eb2e46e98f4d20260809baf0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:47.794545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:47.862711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c48c44eb2e46e98f4d20260809baf0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:47.870960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c48c44eb2e46e98f4d20260809baf0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:47.878254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1004/2016] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:46 2022] DELETE /identity/v3/users/f6c48c44eb2e46e98f4d20260809baf0 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:47.882980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:47.883270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:47.883555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:47.904128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:47.907764 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:47.980621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1013/2017] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:47.991891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:47.993806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:48.077805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2226c4-2120-43e6-aa7b-a1d3387c66c5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:48.085908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:48.098976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.101753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.102185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.128523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:48.132456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.133460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:48.151682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1005/2018] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:48.354758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.597849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.035689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.226482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:49.227980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:49.245306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558d417-3704-4125-a56a-80db6e6dff34 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.255047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.256155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.256595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.257017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] PATH_INFO: `/v3/projects/10ab19ec73934c4dbdac4f9596b0b65a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.259276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ab19ec73934c4dbdac4f9596b0b65a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.261858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.413264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ab19ec73934c4dbdac4f9596b0b65a', 'request_id': 'req-6a524b7d-1058-4be8-aefb-7cc7cd60d144'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.536713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ab19ec73934c4dbdac4f9596b0b65a', 'request_id': 'req-6a524b7d-1058-4be8-aefb-7cc7cd60d144'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.546819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ab19ec73934c4dbdac4f9596b0b65a', 'request_id': 'req-6a524b7d-1058-4be8-aefb-7cc7cd60d144'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.560491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] The token cache is being invalidate because project 10ab19ec73934c4dbdac4f9596b0b65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:49.561091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.562029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.564314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1014/2019] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:49 2022] DELETE /identity/v3/projects/10ab19ec73934c4dbdac4f9596b0b65a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:49.570808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:49.578540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad032-4e4b-47ae-b8cb-5f7138d27002 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.678673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.678673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.678673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.678673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] PATH_INFO: `/v3/users/ab2dbf3817fd4dc195d7a133069661a7` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.680802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2dbf3817fd4dc195d7a133069661a7)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.683421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.938512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.965588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2dbf3817fd4dc195d7a133069661a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.979580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2dbf3817fd4dc195d7a133069661a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:49.980663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2dbf3817fd4dc195d7a133069661a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:50.109263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2dbf3817fd4dc195d7a133069661a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:50.120304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-baa8747c-3ecf-4841-8707-30100516f92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2dbf3817fd4dc195d7a133069661a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:50.127467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1006/2020] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:40:49 2022] DELETE /identity/v3/users/ab2dbf3817fd4dc195d7a133069661a7 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:50.831997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:50.835569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:50.892194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a524b7d-1058-4be8-aefb-7cc7cd60d144 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:50.988594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:50.989619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.990052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.990375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] PATH_INFO: `/v3/projects/1f5729fce3244db5906ebb5f38c2337c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.991659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5729fce3244db5906ebb5f38c2337c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:50.993775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.259680 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5729fce3244db5906ebb5f38c2337c', 'request_id': 'req-9ef16c1d-b41b-459a-adfa-4f438631e0c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:51.412484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5729fce3244db5906ebb5f38c2337c', 'request_id': 'req-9ef16c1d-b41b-459a-adfa-4f438631e0c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:51.423107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5729fce3244db5906ebb5f38c2337c', 'request_id': 'req-9ef16c1d-b41b-459a-adfa-4f438631e0c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:51.438859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] The token cache is being invalidate because project 1f5729fce3244db5906ebb5f38c2337c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:40:51.439404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:51.441001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9ef16c1d-b41b-459a-adfa-4f438631e0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:40:51.443755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1015/2021] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:40:50 2022] DELETE /identity/v3/projects/1f5729fce3244db5906ebb5f38c2337c => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:51.448684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.449602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.449907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.478218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:51.480305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:51.566076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1007/2022] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:51.574572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.574572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.574572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.600425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:51.601834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:51.616949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1016/2023] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:51.622434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.646807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0a83-da38-4c9e-8639-de28421316a6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.656064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.657113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.657438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.657876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.659021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:51.659684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.662580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.692878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1008/2024] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:51.694415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.707388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb9a4-07ae-44de-ba70-7f0741cb7ac4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.713391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.714398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.714952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.715587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.716969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.719079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.840185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.946625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1017/2025] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/projects => generated 407 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:51.947603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.962780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e987b-53dd-4db9-bafe-fd225fbed3b6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.000810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:52.052570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.053764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.054219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.055338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.056261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.058528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:52.209933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1009/2026] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/users => generated 304 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:52.215043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:52.229978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440a5e-66a4-4b77-86eb-384ba4301bc2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.238093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.239134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.246487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.246487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.246487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.246487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:52.255718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1018/2027] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:52.259999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:52.273634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9c9c-29e7-48fa-a08e-13a559de8dfd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.279826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faae60-0dd1-4b5b-8f59-aea78268b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.280649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faae60-0dd1-4b5b-8f59-aea78268b795 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.281032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faae60-0dd1-4b5b-8f59-aea78268b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.281434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faae60-0dd1-4b5b-8f59-aea78268b795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.282209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faae60-0dd1-4b5b-8f59-aea78268b795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.284010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faae60-0dd1-4b5b-8f59-aea78268b795 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:52.297939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1010/2028] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:52.302444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:52.317751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487e06-ed0d-4b18-88f4-d24dec9585ad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.329984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.330664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.331162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.331593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] PATH_INFO: `/v3/projects/0919c14240984284ae715296514d688d/users/ec296506efbd4f84ae833125efe887ef/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.383282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0919c14240984284ae715296514d688d, user_id=ec296506efbd4f84ae833125efe887ef, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.386727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:52.504894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1019/2029] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:52 2022] PUT /identity/v3/projects/0919c14240984284ae715296514d688d/users/ec296506efbd4f84ae833125efe887ef/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:52.517367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.518076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.518076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.554539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] MFA Rules not processed for user `ec296506efbd4f84ae833125efe887ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:52.555901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:52.687772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1011/2030] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:52.692367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:52.813784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23b62-423f-4c01-b53c-f6fac15d356b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.824554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.833813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.833813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.833813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.833813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.835485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.005068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1020/2031] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:40:52 2022] POST /identity/v3/projects => generated 409 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:53.006033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.020919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c01e9-b415-40cd-aae1-847a1c653da2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.118631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.119305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.119589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.119865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.120513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.122645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.303533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1012/2032] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:53 2022] POST /identity/v3/users => generated 311 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:53.305944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.327758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a48aa-ed49-4d49-bfee-43f0b5d8700f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.333127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.334484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.335032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.335492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.336333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.338441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.377703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1021/2033] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:53.377843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.385577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982918b4-19b9-4c24-90b9-228d9db25b77 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.393660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.394362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.394973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.395477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] PATH_INFO: `/v3/projects/1f664ad5b1a244d0a7fde59ae164758c/users/48117dc7106d49c3aae407aeadad8bfd/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.495574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f664ad5b1a244d0a7fde59ae164758c, user_id=48117dc7106d49c3aae407aeadad8bfd, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.499784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.635790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1013/2034] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:53 2022] PUT /identity/v3/projects/1f664ad5b1a244d0a7fde59ae164758c/users/48117dc7106d49c3aae407aeadad8bfd/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:53.638493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.651704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e0356-06f4-4672-87f4-ca88d3b29518 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.755218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39f7c4-b10f-43ea-9243-709aa5ed2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.755913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f7c4-b10f-43ea-9243-709aa5ed2f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.756428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f7c4-b10f-43ea-9243-709aa5ed2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.756853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f7c4-b10f-43ea-9243-709aa5ed2f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.757737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39f7c4-b10f-43ea-9243-709aa5ed2f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.760721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39f7c4-b10f-43ea-9243-709aa5ed2f95 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.782115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1022/2035] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:53.787499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.802929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7dd20-1cc3-4b59-87f0-e78b50f135cf admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.808358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.809125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.809478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.809833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] PATH_INFO: `/v3/projects/1f664ad5b1a244d0a7fde59ae164758c/users/48117dc7106d49c3aae407aeadad8bfd/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.813007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f664ad5b1a244d0a7fde59ae164758c, user_id=48117dc7106d49c3aae407aeadad8bfd, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.815850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.829177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1014/2036] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:40:53 2022] PUT /identity/v3/projects/1f664ad5b1a244d0a7fde59ae164758c/users/48117dc7106d49c3aae407aeadad8bfd/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:53.844221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.844672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.845252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.901030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] MFA Rules not processed for user `48117dc7106d49c3aae407aeadad8bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:53.904387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:54.026611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1023/2037] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:54.039839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.041922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:54.122137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7c403-9247-4598-8d48-c08febbbd0f3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.142755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587067f3-a7af-42bc-ab25-5d2c8df24c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.144006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587067f3-a7af-42bc-ab25-5d2c8df24c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.148853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587067f3-a7af-42bc-ab25-5d2c8df24c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.150130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587067f3-a7af-42bc-ab25-5d2c8df24c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.175127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587067f3-a7af-42bc-ab25-5d2c8df24c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.177430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587067f3-a7af-42bc-ab25-5d2c8df24c77 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.218905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1015/2038] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:54.709347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.799836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.820469 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bad42-2644-4c6d-8ea5-a7ede5596753 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.831872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.832859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.833427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.833601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.990776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:55.107691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:55.107691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:55.117306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1024/2039] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:55.271448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb74bb-74ca-4b5b-bf63-86246be711e4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:55.271731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb74bb-74ca-4b5b-bf63-86246be711e4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:55.272010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb74bb-74ca-4b5b-bf63-86246be711e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:55.324183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6efb74bb-74ca-4b5b-bf63-86246be711e4 None None] MFA Rules not processed for user `1e7b37a53a2644c5b4e75c6eb06792a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:55.326260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6efb74bb-74ca-4b5b-bf63-86246be711e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:55.417495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1016/2040] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:55.432614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:55.434095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:55.533014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d41fa0-cc28-498a-abf0-6d86dc0b3c2d service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:55.539153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:55.539880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:55.540165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:55.540998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:55.550318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:55.551983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:55.562335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1025/2041] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:59.297778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:59.587694 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a60f4d-b14b-4624-a528-3cf9d166d59e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:59.588183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a60f4d-b14b-4624-a528-3cf9d166d59e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:59.588299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a60f4d-b14b-4624-a528-3cf9d166d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:59.612625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-53a60f4d-b14b-4624-a528-3cf9d166d59e None None] MFA Rules not processed for user `1e7b37a53a2644c5b4e75c6eb06792a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:59.614095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-53a60f4d-b14b-4624-a528-3cf9d166d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:59.629021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1017/2042] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:40:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:04.646267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:04.838155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:04.934742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02791-ae3d-4421-bbea-f07b67c5c1b9 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:04.940913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:04.946132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:04.946508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:04.950970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] PATH_INFO: `/v3/users/ec296506efbd4f84ae833125efe887ef` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:04.953865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec296506efbd4f84ae833125efe887ef)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:04.956421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:05.373804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec296506efbd4f84ae833125efe887ef'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:05.375261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec296506efbd4f84ae833125efe887ef'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:05.389618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec296506efbd4f84ae833125efe887ef'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:05.503227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec296506efbd4f84ae833125efe887ef'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:05.504207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec296506efbd4f84ae833125efe887ef'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:05.518420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1026/2043] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:04 2022] DELETE /identity/v3/users/ec296506efbd4f84ae833125efe887ef => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:05.522836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.523384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.523384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.531969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:05.544799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:05.546261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:05.639617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1018/2044] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:05.650238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.651893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:05.742202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67194f6-1f79-4b89-bc68-045b79e37e2a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:05.748018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:05.748710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.749064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.749750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.762815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:05.765190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:05.778150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1027/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:06.431126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.432827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:06.446021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e649-e165-4e87-8a33-0549bb11f91e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.451345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.452240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.452807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.452807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] PATH_INFO: `/v3/projects/0919c14240984284ae715296514d688d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.453930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0919c14240984284ae715296514d688d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.456037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.613122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0919c14240984284ae715296514d688d', 'request_id': 'req-37dce2ec-8e87-4e77-84c1-4950caa0956b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:06.749079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0919c14240984284ae715296514d688d', 'request_id': 'req-37dce2ec-8e87-4e77-84c1-4950caa0956b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:06.761585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0919c14240984284ae715296514d688d', 'request_id': 'req-37dce2ec-8e87-4e77-84c1-4950caa0956b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:06.777477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] The token cache is being invalidate because project 0919c14240984284ae715296514d688d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:06.778137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:06.778994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:06.781104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1019/2046] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:06 2022] DELETE /identity/v3/projects/0919c14240984284ae715296514d688d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:06.785271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.803910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2056-c198-4657-a2b5-38fd42a89fea service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.898951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.900188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.900961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.901424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] PATH_INFO: `/v3/users/48117dc7106d49c3aae407aeadad8bfd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.903018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48117dc7106d49c3aae407aeadad8bfd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.905173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:07.266669 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48117dc7106d49c3aae407aeadad8bfd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:07.267366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48117dc7106d49c3aae407aeadad8bfd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:07.279113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48117dc7106d49c3aae407aeadad8bfd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:07.380007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48117dc7106d49c3aae407aeadad8bfd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:07.380648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a2a001ee-6694-4e23-93f6-4d54d245c76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48117dc7106d49c3aae407aeadad8bfd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:07.402063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1028/2047] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:06 2022] DELETE /identity/v3/users/48117dc7106d49c3aae407aeadad8bfd => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:07.996524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:07.998595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:08.016750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce2ec-8e87-4e77-84c1-4950caa0956b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:08.093352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:08.094163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.094452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.094896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] PATH_INFO: `/v3/projects/1f664ad5b1a244d0a7fde59ae164758c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.096348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f664ad5b1a244d0a7fde59ae164758c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:08.098263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:08.292162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f664ad5b1a244d0a7fde59ae164758c', 'request_id': 'req-4cf3f996-66e5-4580-a41e-dedf10da2319'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:08.405921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f664ad5b1a244d0a7fde59ae164758c', 'request_id': 'req-4cf3f996-66e5-4580-a41e-dedf10da2319'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:08.413680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f664ad5b1a244d0a7fde59ae164758c', 'request_id': 'req-4cf3f996-66e5-4580-a41e-dedf10da2319'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:08.425517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] The token cache is being invalidate because project 1f664ad5b1a244d0a7fde59ae164758c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:08.425807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:08.426499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4cf3f996-66e5-4580-a41e-dedf10da2319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:08.431920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1020/2048] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:07 2022] DELETE /identity/v3/projects/1f664ad5b1a244d0a7fde59ae164758c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:08.433795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.434973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.434973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.463177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:08.463177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:08.560845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:08.568091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1029/2049] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:08.573107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.573480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.573847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.604206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:08.605722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:08.616987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1021/2050] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:08.621187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:08.635306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931a99-91e9-4081-81de-f874bc002509 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:08.646020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:08.647923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.648701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.648701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.649232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:08.649542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:08.651607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:08.680927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1030/2051] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:08.690613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:08.697317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411da3-8683-4b97-917d-13eefe959dde None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:08.704121 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:08.704867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.705219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.705573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.706321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:08.708451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:08.839066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1022/2052] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:08 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:08.839835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:08.851600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16691fce-a07d-45d5-9f83-052450b62e85 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:08.931671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:08.933285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.933285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.933285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.933675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:08.936058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.102333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1031/2053] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:08 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:09.103880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:09.115274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2015b0-6186-4078-b7fb-c335a868891c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:09.120642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:09.121330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.121684 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.122027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.122924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:09.124946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.139477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1023/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:09.140745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:09.152017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd9d2-c508-4ebc-995b-7068400957d0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:09.159382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136498a6-60eb-4a10-8a32-eff23e093a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:09.160149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136498a6-60eb-4a10-8a32-eff23e093a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.160530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136498a6-60eb-4a10-8a32-eff23e093a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.160752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136498a6-60eb-4a10-8a32-eff23e093a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.161477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136498a6-60eb-4a10-8a32-eff23e093a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:09.163214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136498a6-60eb-4a10-8a32-eff23e093a33 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.177833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1032/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:09.183969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:09.200523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60053ce8-bd7c-4e1c-bae1-fd646d665716 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:09.207277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:09.208394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.208866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.209291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] PATH_INFO: `/v3/projects/9943f8d6a85c478db15da7521a882842/users/410f946c900840c5a34e947d980d6c95/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.230107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9943f8d6a85c478db15da7521a882842, user_id=410f946c900840c5a34e947d980d6c95, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:09.234408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.275048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:09.395244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1024/2056] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:09 2022] PUT /identity/v3/projects/9943f8d6a85c478db15da7521a882842/users/410f946c900840c5a34e947d980d6c95/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:09.406198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.406483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.406790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.444448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] MFA Rules not processed for user `410f946c900840c5a34e947d980d6c95`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:09.445818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:09.539821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1033/2057] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:09.553107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:09.554892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:09.626951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3c8a-2e04-4cd7-8e8c-2bf0a4dc9574 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:09.631814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0afbb-6351-44c8-af5e-b852f0f22929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:09.637258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0afbb-6351-44c8-af5e-b852f0f22929 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.637258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0afbb-6351-44c8-af5e-b852f0f22929 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.637258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0afbb-6351-44c8-af5e-b852f0f22929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.642811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0afbb-6351-44c8-af5e-b852f0f22929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:09.644360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0afbb-6351-44c8-af5e-b852f0f22929 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.653230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1025/2058] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:10.063559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:10.065323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:10.136787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69c234-653d-4891-be32-5f5aff24f321 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:10.142158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:10.142819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:10.143227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:10.143399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] PATH_INFO: `/v3/users/c0865f4beb384fb782477b0b8a21d8fe` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:10.144555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0865f4beb384fb782477b0b8a21d8fe)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:10.146389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:10.347456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0865f4beb384fb782477b0b8a21d8fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:10.348123 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0865f4beb384fb782477b0b8a21d8fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:10.362266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0865f4beb384fb782477b0b8a21d8fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:10.443169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0865f4beb384fb782477b0b8a21d8fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:10.443169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0865f4beb384fb782477b0b8a21d8fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:10.456009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:10.471819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1034/2059] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:10 2022] DELETE /identity/v3/users/c0865f4beb384fb782477b0b8a21d8fe => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:10.478235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:10.479050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:10.479050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:10.522172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:10.523695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:10.655205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1026/2060] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:10.665033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:10.666641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:10.736995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e245-3513-49d0-a53b-a209c0ff55e3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:10.740539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2de16f-e9ff-4d01-8640-e931f8d6057e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:10.741319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2de16f-e9ff-4d01-8640-e931f8d6057e service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:10.741625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2de16f-e9ff-4d01-8640-e931f8d6057e service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:10.741883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2de16f-e9ff-4d01-8640-e931f8d6057e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:10.752307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2de16f-e9ff-4d01-8640-e931f8d6057e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:10.753865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2de16f-e9ff-4d01-8640-e931f8d6057e service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:10.764229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1035/2061] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:11.338345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:11.339912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:11.352885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571412f-6c5b-4047-9460-a86e8a1a86ea None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:11.358231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:11.358967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.359206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.359762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] PATH_INFO: `/v3/projects/8f7d0f891ef5459c84adccd3139acc38` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.361491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7d0f891ef5459c84adccd3139acc38)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:11.363921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:11.555024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7d0f891ef5459c84adccd3139acc38', 'request_id': 'req-37d2484f-9832-4466-80d9-bb37bda4c981'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:11.611921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7d0f891ef5459c84adccd3139acc38', 'request_id': 'req-37d2484f-9832-4466-80d9-bb37bda4c981'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:11.621263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7d0f891ef5459c84adccd3139acc38', 'request_id': 'req-37d2484f-9832-4466-80d9-bb37bda4c981'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:11.634385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] The token cache is being invalidate because project 8f7d0f891ef5459c84adccd3139acc38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:11.635032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:11.636279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-37d2484f-9832-4466-80d9-bb37bda4c981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:11.638985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1027/2062] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:11 2022] DELETE /identity/v3/projects/8f7d0f891ef5459c84adccd3139acc38 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:11.644444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.644922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.645046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.671052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:11.673565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:11.754817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1036/2063] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:11.762566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.762997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.763273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.785863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:11.787272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:11.795601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1028/2064] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:11.801163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:11.811863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f4dd2-4df3-40f3-81a2-b8dd6f084ff1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:11.817790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:11.818400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.818674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.818980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.819633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:11.819940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:11.821528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:11.837727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1037/2065] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:11.842778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:11.855437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844233f0-1a8e-4b32-8892-46de9a732d12 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:11.864630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:11.865754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.866379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.866912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.868076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:11.872299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:11.978857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1029/2066] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:11 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:11.983255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:11.994070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442841b0-5aa0-47e2-9418-a81feac5cef6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.052424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.053031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.053313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.053593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.054295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.056170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.154855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1038/2067] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:11 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:12.160087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.171110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ab5c-17b3-4a36-9335-62dce4979f5d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.176760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.177373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.177650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.177924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.178569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.187126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.199896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1030/2068] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:12.204768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.217696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aacd79-b781-4cd0-8076-827878389030 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.224074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad672f69-4ac9-4784-a7b4-6ced980e2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.224732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad672f69-4ac9-4784-a7b4-6ced980e2633 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.225199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad672f69-4ac9-4784-a7b4-6ced980e2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.225476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad672f69-4ac9-4784-a7b4-6ced980e2633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.226175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad672f69-4ac9-4784-a7b4-6ced980e2633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.227825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad672f69-4ac9-4784-a7b4-6ced980e2633 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.246600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1039/2069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:12.247824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.258704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe84df-3da9-4bd3-990a-7fb871a78299 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.266090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.267138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.267421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.267804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] PATH_INFO: `/v3/projects/8ab718c19e5f4ae6a7af4dc6f2ba709a/users/0b8cfe691e0848d880fb4d88e15f9abd/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.284030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab718c19e5f4ae6a7af4dc6f2ba709a, user_id=0b8cfe691e0848d880fb4d88e15f9abd, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.286736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.389380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1031/2070] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:12 2022] PUT /identity/v3/projects/8ab718c19e5f4ae6a7af4dc6f2ba709a/users/0b8cfe691e0848d880fb4d88e15f9abd/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:12.395335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39667c-e4d5-4d48-81a3-1450f3cfb66c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.395624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39667c-e4d5-4d48-81a3-1450f3cfb66c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.395899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39667c-e4d5-4d48-81a3-1450f3cfb66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.417300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1f39667c-e4d5-4d48-81a3-1450f3cfb66c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:12.418434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f39667c-e4d5-4d48-81a3-1450f3cfb66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:12.477304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1040/2071] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:12.487533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.489503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:12.522521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:12.580511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920f0bd-dd57-408e-8352-da33a127d32e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.585561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.586274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.586803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.587079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.602537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.602537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.621273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1032/2072] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:14.195409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:15.520209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:15.521294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:15.521635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:15.544029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:15.545436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:15.631255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1041/2073] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:15.699574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:15.701062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:15.794223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f295e20-b104-4b06-9962-87db1f6a461e service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:15.800137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:15.801245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:15.801605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:15.801951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:15.811921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:15.814483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:15.824492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1033/2074] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:41:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:41:15.841295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:17.480089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:17.482203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:17.512013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdb893-4154-43c3-a3e0-3c0188ef5c2b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:17.519933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:17.522222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:17.523213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:17.523985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] PATH_INFO: `/v3/users/d6355623ef6a48548e3fa8c4f60c198b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:17.526215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6355623ef6a48548e3fa8c4f60c198b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:17.534155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:17.860274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6355623ef6a48548e3fa8c4f60c198b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:17.862127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6355623ef6a48548e3fa8c4f60c198b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:17.912618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6355623ef6a48548e3fa8c4f60c198b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:17.936039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:18.017649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6355623ef6a48548e3fa8c4f60c198b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:18.018667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6355623ef6a48548e3fa8c4f60c198b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:18.051924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1042/2075] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:17 2022] DELETE /identity/v3/users/d6355623ef6a48548e3fa8c4f60c198b => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:18.478517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:18.501859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f40d7-8106-4f1a-aae5-3d63b9e6a2ce service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:18.694774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:18.695599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:18.696114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:18.696599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] PATH_INFO: `/v3/projects/7f1fd44c99014c53959411954b0a02e5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:18.697985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1fd44c99014c53959411954b0a02e5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:18.700301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:18.835096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1fd44c99014c53959411954b0a02e5', 'request_id': 'req-550b12fd-053d-4e2e-9ec2-f716ae39ea12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.028784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1fd44c99014c53959411954b0a02e5', 'request_id': 'req-550b12fd-053d-4e2e-9ec2-f716ae39ea12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.057639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1fd44c99014c53959411954b0a02e5', 'request_id': 'req-550b12fd-053d-4e2e-9ec2-f716ae39ea12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.094739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] The token cache is being invalidate because project 7f1fd44c99014c53959411954b0a02e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:19.094739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.100507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.107548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1034/2076] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:18 2022] DELETE /identity/v3/projects/7f1fd44c99014c53959411954b0a02e5 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:19.112566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:19.119038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:19.130386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0760-6f7d-4fae-afba-5bf1c4598119 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:19.196757 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:19.197818 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:19.199162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:19.199482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] PATH_INFO: `/v3/users/4926ded36cbb4555b904e2721a368b34` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:19.201238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4926ded36cbb4555b904e2721a368b34)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:19.206647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:19.496085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4926ded36cbb4555b904e2721a368b34'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.497886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4926ded36cbb4555b904e2721a368b34'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.519234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4926ded36cbb4555b904e2721a368b34'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.605650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4926ded36cbb4555b904e2721a368b34'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.618409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbf96176-0ed4-415a-808d-e3ac804197f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4926ded36cbb4555b904e2721a368b34'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:19.658467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1043/2077] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:19 2022] DELETE /identity/v3/users/4926ded36cbb4555b904e2721a368b34 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:19.806490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:20.134136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:20.135777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:20.184233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b12fd-053d-4e2e-9ec2-f716ae39ea12 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:20.259124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:20.310739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:20.311415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:20.311697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:20.313123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] PATH_INFO: `/v3/projects/a3c752d083124b36a2882e33bd8f06cc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:20.314934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c752d083124b36a2882e33bd8f06cc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:20.317115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:20.535294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c752d083124b36a2882e33bd8f06cc', 'request_id': 'req-aca1be9f-7242-4096-8fde-a63aa344a343'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:20.675747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c752d083124b36a2882e33bd8f06cc', 'request_id': 'req-aca1be9f-7242-4096-8fde-a63aa344a343'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:20.685346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c752d083124b36a2882e33bd8f06cc', 'request_id': 'req-aca1be9f-7242-4096-8fde-a63aa344a343'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:20.811865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] The token cache is being invalidate because project a3c752d083124b36a2882e33bd8f06cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:20.812297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:20.818288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aca1be9f-7242-4096-8fde-a63aa344a343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:20.824313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1035/2078] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:20 2022] DELETE /identity/v3/projects/a3c752d083124b36a2882e33bd8f06cc => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:20.825895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:20.826378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:20.826578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:20.894902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:20.895692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:21.040056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1044/2079] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:21.051784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.052107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.054851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.113825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:21.115427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:21.180822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:21.182288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1036/2080] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:21.211448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5790-5e37-4636-bcb6-c52a415f7b33 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.245078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.245839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.246192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.246539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.247313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:21.248211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:21.251395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:21.297804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1045/2081] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:21.301358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:21.312565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a04f-04a6-4e5c-a3d4-904e9632c0a4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.332610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.339836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.340937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.341372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.342200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:21.344569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:21.560940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1037/2082] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:21 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:21.569524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:21.607226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672129-2858-4e6c-9c39-a4e1e8641231 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.760043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.760801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.762108 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.764091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.765262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:21.770658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:21.871102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1046/2083] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:21 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:21.875742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:21.895848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7433ec-0a54-4af2-9ebf-532c57b97342 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.920938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.922009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.923082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.923670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.924597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:21.926598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:21.946773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1038/2084] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:21.948595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:21.960877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db7d7-1be7-4cb9-a233-27d4504aec7b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.977703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8c084-a112-438f-91f3-93251976a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.980078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c084-a112-438f-91f3-93251976a6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.980519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c084-a112-438f-91f3-93251976a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.980939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c084-a112-438f-91f3-93251976a6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.983989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8c084-a112-438f-91f3-93251976a6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:22.002663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8c084-a112-438f-91f3-93251976a6a8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:22.031045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1047/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:22.034268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:22.056209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a30e2-5b5c-4da0-b26d-bdaa86f4f139 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:22.082984 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:22.083783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:22.084181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:22.084711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] PATH_INFO: `/v3/projects/5c3a17144bae4583a13270a9e3bc4b63/users/e396c6f7b2e04f038d6617e8e12236c2/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:22.128608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3a17144bae4583a13270a9e3bc4b63, user_id=e396c6f7b2e04f038d6617e8e12236c2, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:22.134595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:22.396730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1039/2086] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:22 2022] PUT /identity/v3/projects/5c3a17144bae4583a13270a9e3bc4b63/users/e396c6f7b2e04f038d6617e8e12236c2/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:22.408076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:22.408768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:22.409225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:22.508671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] MFA Rules not processed for user `e396c6f7b2e04f038d6617e8e12236c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:22.509925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:22.692824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:22.778672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1048/2087] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:22.783693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.008057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d8301-a53b-478a-8eac-85a83dfffaa4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.020699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7625c-24b5-4419-84a8-b5fdbd6eaf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.021719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7625c-24b5-4419-84a8-b5fdbd6eaf5a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.022388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7625c-24b5-4419-84a8-b5fdbd6eaf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.023011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7625c-24b5-4419-84a8-b5fdbd6eaf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.024397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7625c-24b5-4419-84a8-b5fdbd6eaf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.034147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7625c-24b5-4419-84a8-b5fdbd6eaf5a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.221843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1040/2088] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:22 2022] POST /identity/v3/projects => generated 383 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:41:23.223569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.246352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84e80-f943-42d9-9de5-87fa70c4c9f0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.367320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.374095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.374814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.375288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.376313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.378663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.490342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.491454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.491876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.531408 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1049/2089] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:23 2022] POST /identity/v3/users => generated 298 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:23.535644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.550365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] MFA Rules not processed for user `0b8cfe691e0848d880fb4d88e15f9abd`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:23.554322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:23.560506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5450cd-6bd5-4e28-ab83-bfb9210b71b4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.569474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.579622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.579622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.579622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.579622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.579622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.590718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1050/2090] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:23.620675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.635284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b8e3-082e-4899-bdba-d03718c6a40e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.642834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.644626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.645066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.645494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] PATH_INFO: `/v3/projects/83705283d37b4584a1f6801a06c007ad/users/0042b84245d340ab8e0010d3f4bdd8c4/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.679060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1041/2091] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:23.682065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83705283d37b4584a1f6801a06c007ad, user_id=0042b84245d340ab8e0010d3f4bdd8c4, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.686015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.686275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.689346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:23.711936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82664448-3aa8-40a4-a06b-e7ca9ca4e470 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.717976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.718771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.719192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.719323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.720248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.722388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.766385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:23.776311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1051/2092] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:23 2022] PUT /identity/v3/projects/83705283d37b4584a1f6801a06c007ad/users/0042b84245d340ab8e0010d3f4bdd8c4/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:23.781606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.828588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1042/2093] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:23 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:41:23.832722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.955723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31dca4-4857-4f8e-b67e-a3c803e1136d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.980799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c228-809a-4c48-9210-9712d76e88e1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.988326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.988957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.989815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.990091 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.991583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.993499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.042116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.043658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.043967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.044908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.046729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.051876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.073006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1043/2094] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:23 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:24.076663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:24.083170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1052/2095] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:24.087096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:24.098281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865418b-2590-4bc1-a063-1866b9b05cbc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:24.104558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701a54-9d80-4aa3-afa2-0b99dd7edcc8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:24.110160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.110825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.115256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.115586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.117606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.130459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.146181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef81a-d88b-45bb-82fb-5c1c5bce4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.148215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef81a-d88b-45bb-82fb-5c1c5bce4271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.148215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef81a-d88b-45bb-82fb-5c1c5bce4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.148515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef81a-d88b-45bb-82fb-5c1c5bce4271 admin admin] PATH_INFO: `/v3/projects/83705283d37b4584a1f6801a06c007ad/users/0042b84245d340ab8e0010d3f4bdd8c4/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.168479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef81a-d88b-45bb-82fb-5c1c5bce4271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83705283d37b4584a1f6801a06c007ad, user_id=0042b84245d340ab8e0010d3f4bdd8c4, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.173206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1044/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:41:24.178605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:24.191564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef81a-d88b-45bb-82fb-5c1c5bce4271 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.216676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290cc8d-cea6-4559-8ba2-bbfeef496d46 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:24.227220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1053/2097] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:24 2022] PUT /identity/v3/projects/83705283d37b4584a1f6801a06c007ad/users/0042b84245d340ab8e0010d3f4bdd8c4/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:24.241623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.242275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.242788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.302728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] MFA Rules not processed for user `0042b84245d340ab8e0010d3f4bdd8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:24.304006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:24.432498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.438111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.438483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.438812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] PATH_INFO: `/v3/projects/5663710299e747dda09b21d027dff0e6/users/71f9afaced7a427885bd61aa8222f819/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.495891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5663710299e747dda09b21d027dff0e6, user_id=71f9afaced7a427885bd61aa8222f819, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.502668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.546859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1054/2098] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:24.559774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:24.561246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:24.629875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1045/2099] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:24 2022] PUT /identity/v3/projects/5663710299e747dda09b21d027dff0e6/users/71f9afaced7a427885bd61aa8222f819/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:24.634495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:24.688345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70861-9a86-4e7c-a2f4-46b43b81fde2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:24.767040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c98bb7-f5f8-47b8-8871-532b85714c82 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:24.780115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.781476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.782178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.782942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.784216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.786544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.797673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.798166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.798483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.798839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.800153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1046/2100] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:24.804441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:24.816992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6e8a-6c1b-4fe8-b52f-0b1415b23a0a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:24.822834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:24.823951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:24.824562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:24.825146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] PATH_INFO: `/v3/projects/5663710299e747dda09b21d027dff0e6/users/71f9afaced7a427885bd61aa8222f819/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:24.828574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5663710299e747dda09b21d027dff0e6, user_id=71f9afaced7a427885bd61aa8222f819, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.833346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.846263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1047/2101] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:24 2022] PUT /identity/v3/projects/5663710299e747dda09b21d027dff0e6/users/71f9afaced7a427885bd61aa8222f819/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:24.891091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:24.894195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:24.921637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1055/2102] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:41:25.578471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:27.253615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:30.566561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:31.164135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:31.166351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:31.280795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011d34-6f68-4b0e-bbba-4e83650ca336 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:31.300767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:31.303920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:31.305395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:31.307059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] PATH_INFO: `/v3/users/410f946c900840c5a34e947d980d6c95` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:31.310578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410f946c900840c5a34e947d980d6c95)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:31.314876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:31.703883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:31.710818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410f946c900840c5a34e947d980d6c95'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:31.763263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410f946c900840c5a34e947d980d6c95'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:31.764036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410f946c900840c5a34e947d980d6c95'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:31.887821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410f946c900840c5a34e947d980d6c95'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:31.924955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d330a000-d617-4e1a-aa45-01e1833864f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410f946c900840c5a34e947d980d6c95'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:31.952886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:31.956323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:31.970250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1048/2103] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:31 2022] DELETE /identity/v3/users/410f946c900840c5a34e947d980d6c95 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:31.978199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192532-993c-46d8-a023-94a930a3d303 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:31.984455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2cf9-caff-427a-8e0e-51ff21732b95 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:31.984704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192532-993c-46d8-a023-94a930a3d303 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:31.984704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192532-993c-46d8-a023-94a930a3d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.031828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-66192532-993c-46d8-a023-94a930a3d303 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:32.034452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-66192532-993c-46d8-a023-94a930a3d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:32.129744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:32.131496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:32.134645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:32.135115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.137519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:32.222419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1049/2104] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:32.252430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192532-993c-46d8-a023-94a930a3d303 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:32.254916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-66192532-993c-46d8-a023-94a930a3d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:32.257807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:32.261287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:32.280862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1056/2105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:41:32.378491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192532-993c-46d8-a023-94a930a3d303 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:32.383817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138dae2-d951-490a-a945-e5363c8ad5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:32.384503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138dae2-d951-490a-a945-e5363c8ad5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:32.384829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138dae2-d951-490a-a945-e5363c8ad5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:32.385104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138dae2-d951-490a-a945-e5363c8ad5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.399219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138dae2-d951-490a-a945-e5363c8ad5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:32.401536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138dae2-d951-490a-a945-e5363c8ad5a5 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:32.426026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1050/2106] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:33.299107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:33.643874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:33.652315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:33.681242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ec45d-b902-4a42-97b3-f631e86bc882 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:33.698180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:33.699664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:33.700170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:33.703498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] PATH_INFO: `/v3/projects/9943f8d6a85c478db15da7521a882842` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:33.705389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9943f8d6a85c478db15da7521a882842)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:33.711795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:33.928091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9943f8d6a85c478db15da7521a882842', 'request_id': 'req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:34.040202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9943f8d6a85c478db15da7521a882842', 'request_id': 'req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:34.059565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9943f8d6a85c478db15da7521a882842', 'request_id': 'req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:34.110835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] The token cache is being invalidate because project 9943f8d6a85c478db15da7521a882842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:34.111127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:34.111803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d7e3a92-73fd-4721-8bd0-2d262bb941ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:34.120004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1057/2107] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:33 2022] DELETE /identity/v3/projects/9943f8d6a85c478db15da7521a882842 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:34.121601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:34.128809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:34.128809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:34.167741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:34.169777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:34.285276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1051/2108] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:34.288746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:34.289310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:34.289430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:34.323627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:34.325534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:34.338736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1058/2109] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:34.341673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:34.376794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea79e6f-2492-4fea-b76d-3d3b4bea074e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:34.396166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:34.397163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:34.397445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:34.397886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:34.398652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:34.398942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:34.400624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:34.435305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1052/2110] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:34.439074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:34.476109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b03d55-f829-477d-8a0e-1946529712b1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:34.519769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:34.520063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:34.521864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:34.522168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:34.522835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:34.524916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:34.688679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1059/2111] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:34 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:41:34.693367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:34.722766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0117f-9969-4173-8ebc-45a5cec93b64 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:34.907989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:34.908890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:34.909174 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:34.909941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:34.910180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:34.915570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:35.078393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1053/2112] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:34 2022] POST /identity/v3/users => generated 292 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:35.083573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:35.115218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26f40-8f9a-433d-8a9a-6a7fdad0e5e3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:35.138115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:35.139334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.139878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.140431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.141375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:35.148122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:35.185467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1060/2113] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:35.191615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:35.221164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd82f1-7927-46d9-87c6-2a7a1e6666b4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:35.248054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d932f-5513-4f6a-8eb1-aee93d3dfdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:35.248917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d932f-5513-4f6a-8eb1-aee93d3dfdeb admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.254585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d932f-5513-4f6a-8eb1-aee93d3dfdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.254585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d932f-5513-4f6a-8eb1-aee93d3dfdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.254585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d932f-5513-4f6a-8eb1-aee93d3dfdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:35.254585 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d932f-5513-4f6a-8eb1-aee93d3dfdeb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:35.286838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1054/2114] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:41:35.292616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:35.316725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947158d7-2091-4a50-879d-38993b6a6f44 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:35.333039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:35.335279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.337296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.338794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] PATH_INFO: `/v3/projects/f0e882f7ac9a4a2886bca1e394c39476/users/d4eead0bdfad402a9e8a3940fc9d6b50/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.393741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e882f7ac9a4a2886bca1e394c39476, user_id=d4eead0bdfad402a9e8a3940fc9d6b50, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:35.399039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:35.547356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81fa7-d136-4a02-a75c-5895de39d609 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.547645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81fa7-d136-4a02-a75c-5895de39d609 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.549148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81fa7-d136-4a02-a75c-5895de39d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.552754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:35.554781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1061/2115] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:35 2022] PUT /identity/v3/projects/f0e882f7ac9a4a2886bca1e394c39476/users/d4eead0bdfad402a9e8a3940fc9d6b50/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:35.651751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c5b81fa7-d136-4a02-a75c-5895de39d609 None None] MFA Rules not processed for user `d4eead0bdfad402a9e8a3940fc9d6b50`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:35.653015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c5b81fa7-d136-4a02-a75c-5895de39d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:35.852200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1055/2116] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:35.866185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:35.868460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:35.976455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600fa9a-f65f-4add-84e4-acb3a53b8e24 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:35.981231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795786d-4a4a-4683-b6e5-a25273530dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:35.982557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795786d-4a4a-4683-b6e5-a25273530dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.983105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795786d-4a4a-4683-b6e5-a25273530dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.984241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795786d-4a4a-4683-b6e5-a25273530dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.999824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795786d-4a4a-4683-b6e5-a25273530dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:36.001677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795786d-4a4a-4683-b6e5-a25273530dc5 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:36.028437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:36.037177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1062/2117] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:36.698915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:36.698915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:36.698915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:36.745034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] MFA Rules not processed for user `e1942539e3374378b0b3d7942f6304b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:36.750065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:36.831211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceb917-dc42-4a52-9a21-09d3d45fc9c5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:36.831674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceb917-dc42-4a52-9a21-09d3d45fc9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:36.831954 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceb917-dc42-4a52-9a21-09d3d45fc9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:36.941376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1056/2118] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:36.941608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-15ceb917-dc42-4a52-9a21-09d3d45fc9c5 None None] MFA Rules not processed for user `71f9afaced7a427885bd61aa8222f819`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:36.943560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-15ceb917-dc42-4a52-9a21-09d3d45fc9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:37.131136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1063/2119] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:37.148382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:37.150311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:37.243415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627cc45-1caa-413b-b4e9-07cd3217772e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:37.272892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:37.274798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:37.275052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:37.275326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:37.284693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:37.367852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:37.424044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:37.425784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:37.460860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1057/2120] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:37.893339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:37.898994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:37.898994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:37.965446 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:37.967322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:38.068097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1064/2121] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:41:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:38.104260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:38.105724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:38.268625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312340-2547-4c48-8904-315a3cc68e79 service glance] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:38.279826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:38.280953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:38.281517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:38.282072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:38.293516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:38.295682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:38.308381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1058/2122] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:41:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:41:39.824346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:40.106270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:40.197656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaee4a1-9b82-4737-b1f5-11b915a76ef7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:40.206515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:40.207532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:40.208041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:40.208537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] PATH_INFO: `/v3/users/d4eead0bdfad402a9e8a3940fc9d6b50` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:40.209965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4eead0bdfad402a9e8a3940fc9d6b50)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:40.215784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:40.468517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4eead0bdfad402a9e8a3940fc9d6b50'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:40.470632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4eead0bdfad402a9e8a3940fc9d6b50'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:40.492545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:40.493988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:40.513990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4eead0bdfad402a9e8a3940fc9d6b50'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:40.526417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567242-c656-4f8f-ba4a-427636cda75e service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:40.567732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:40.569423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:40.569894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:40.572070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] PATH_INFO: `/v3/users/e396c6f7b2e04f038d6617e8e12236c2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:40.576305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e396c6f7b2e04f038d6617e8e12236c2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:40.595031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:40.629155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4eead0bdfad402a9e8a3940fc9d6b50'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:40.629924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3a80ae48-f9a4-4544-a10d-7723f129eea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4eead0bdfad402a9e8a3940fc9d6b50'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:40.656262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1065/2123] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:40 2022] DELETE /identity/v3/users/d4eead0bdfad402a9e8a3940fc9d6b50 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:41:40.661772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:40.662297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:40.667673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:40.711804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:40.716331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:40.886018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1066/2124] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:40.908655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:40.910563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:40.965687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e396c6f7b2e04f038d6617e8e12236c2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:41.001574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e396c6f7b2e04f038d6617e8e12236c2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:41.002802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e396c6f7b2e04f038d6617e8e12236c2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:41.064641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc274f-6ee9-4a25-9bbe-d69493ef890b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:41.091632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:41.092397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:41.094228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:41.094751 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:41.109865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e396c6f7b2e04f038d6617e8e12236c2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:41.121643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4b213ab8-ea8c-43d2-9c08-d57410223fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e396c6f7b2e04f038d6617e8e12236c2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:41.124214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:41.130083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:41.155819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1059/2125] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:40 2022] DELETE /identity/v3/users/e396c6f7b2e04f038d6617e8e12236c2 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:41.158288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:41.158882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:41.164208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:41.171847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1067/2126] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:41:41.235399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:41.236850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:41.464162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1060/2127] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:41.603611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:41.605782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:41.662660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13125103-0fb1-4e2b-84d6-fda7fcc505ff service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:41.756571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:41.810790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f095db-0f9e-4483-9577-e3f9b68d7d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:41.814552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f095db-0f9e-4483-9577-e3f9b68d7d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:41.815129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f095db-0f9e-4483-9577-e3f9b68d7d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:41.815577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f095db-0f9e-4483-9577-e3f9b68d7d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:41.873342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f095db-0f9e-4483-9577-e3f9b68d7d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:41.886894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f095db-0f9e-4483-9577-e3f9b68d7d17 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:41.901566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:41.915102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1068/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:42.558211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:42.559865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:42.599325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035025e-6472-404e-b965-f5b6dd80bcbe None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:42.643550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:42.644229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:42.644518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:42.644864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] PATH_INFO: `/v3/projects/f0e882f7ac9a4a2886bca1e394c39476` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:42.652299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e882f7ac9a4a2886bca1e394c39476)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:42.654599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:42.917256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e882f7ac9a4a2886bca1e394c39476', 'request_id': 'req-22879d18-f4de-4104-b910-23fb4a12956a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:42.994791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e882f7ac9a4a2886bca1e394c39476', 'request_id': 'req-22879d18-f4de-4104-b910-23fb4a12956a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.004663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e882f7ac9a4a2886bca1e394c39476', 'request_id': 'req-22879d18-f4de-4104-b910-23fb4a12956a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.038547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] The token cache is being invalidate because project f0e882f7ac9a4a2886bca1e394c39476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:43.039247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.040715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.048425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1061/2129] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:42 2022] DELETE /identity/v3/projects/f0e882f7ac9a4a2886bca1e394c39476 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:43.050772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46f573-b63e-4d80-941c-eb93a2d9da1c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.050772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46f573-b63e-4d80-941c-eb93a2d9da1c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.050772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46f573-b63e-4d80-941c-eb93a2d9da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.093927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:43.095727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:43.105050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cf46f573-b63e-4d80-941c-eb93a2d9da1c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:43.109670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cf46f573-b63e-4d80-941c-eb93a2d9da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:43.341185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879d18-f4de-4104-b910-23fb4a12956a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:43.363562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:43.367077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.373939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1069/2130] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:43.375693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.375693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] PATH_INFO: `/v3/projects/5c3a17144bae4583a13270a9e3bc4b63` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.380597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.380938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.381217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.392407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3a17144bae4583a13270a9e3bc4b63)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:43.394922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:43.447165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:43.448845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:43.479327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1070/2131] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:43.480673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:43.511417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87949947-f12a-4b76-8eff-157d4f6b0bcb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:43.542450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:43.547692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.547692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.547692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.547692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:43.548580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:43.555544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:43.593645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3a17144bae4583a13270a9e3bc4b63', 'request_id': 'req-7d44ffd8-9091-4d4a-9252-8289e4d846da'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.594129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:43.638586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1071/2132] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:43.643798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:43.672100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89228e62-45e0-467e-aded-c10834694234 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:43.720354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3a17144bae4583a13270a9e3bc4b63', 'request_id': 'req-7d44ffd8-9091-4d4a-9252-8289e4d846da'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.731685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3a17144bae4583a13270a9e3bc4b63', 'request_id': 'req-7d44ffd8-9091-4d4a-9252-8289e4d846da'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.798344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] The token cache is being invalidate because project 5c3a17144bae4583a13270a9e3bc4b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:43.799113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.802931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:43.809573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1062/2133] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:43 2022] DELETE /identity/v3/projects/5c3a17144bae4583a13270a9e3bc4b63 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:41:43.811303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:43.813105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:43.849129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:43.850117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.850625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.851170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.853755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:43.858209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:43.920663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:43.997910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1072/2134] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:43 2022] POST /identity/v3/projects => generated 391 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:44.030199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:44.030199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:44.074872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ffd8-9091-4d4a-9252-8289e4d846da admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:44.232144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c335440-142c-468c-a09c-6f7b9d965ece admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:44.254025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:44.254679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.254983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.255249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.257908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:44.259968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:44.323568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:44.324412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.324412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.324659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] PATH_INFO: `/v3/users/0042b84245d340ab8e0010d3f4bdd8c4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.334796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0042b84245d340ab8e0010d3f4bdd8c4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:44.336789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:44.384687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1073/2135] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:44 2022] POST /identity/v3/users => generated 296 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:44.389701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:44.423587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b365d-837e-478c-a0fb-af05262f41ee admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:44.440240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:44.440892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.457511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.460622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.460622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:44.466524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:44.503898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1074/2136] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:44.508588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:44.535741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176731-e082-4a42-bdca-a7469d948fab admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:44.554934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:44.555575 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.556023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.556300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.556987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:44.558594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:44.576441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1075/2137] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:44.587580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:44.627360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf73d-f280-4b60-8fe2-3cf8b00234e5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:44.633682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0042b84245d340ab8e0010d3f4bdd8c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:44.653350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0042b84245d340ab8e0010d3f4bdd8c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:44.654477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0042b84245d340ab8e0010d3f4bdd8c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:44.660854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070e63f-ae4d-490a-b53a-6d084444d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:44.663198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e63f-ae4d-490a-b53a-6d084444d062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.664229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e63f-ae4d-490a-b53a-6d084444d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.666712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e63f-ae4d-490a-b53a-6d084444d062 admin admin] PATH_INFO: `/v3/projects/63f0f783d3cd447da44618951f90eca2/users/1116a8ba73bb4e7d94db170e04303794/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.703801 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0042b84245d340ab8e0010d3f4bdd8c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:44.714148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d616538-59d9-419c-b5ca-34641e918ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0042b84245d340ab8e0010d3f4bdd8c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:44.722471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070e63f-ae4d-490a-b53a-6d084444d062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f0f783d3cd447da44618951f90eca2, user_id=1116a8ba73bb4e7d94db170e04303794, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:44.732924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070e63f-ae4d-490a-b53a-6d084444d062 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:44.738759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1063/2138] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:43 2022] DELETE /identity/v3/users/0042b84245d340ab8e0010d3f4bdd8c4 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:44.808339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1076/2139] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:44 2022] PUT /identity/v3/projects/63f0f783d3cd447da44618951f90eca2/users/1116a8ba73bb4e7d94db170e04303794/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:44.820876 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.821172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.821454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.879512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:44.880204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:44.880801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:44.905965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] MFA Rules not processed for user `e9b3debecd8c402a86fb2ad133bdd7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:44.907611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] MFA Rules not processed for user `1116a8ba73bb4e7d94db170e04303794`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:44.908347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:44.908844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:45.146721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1077/2140] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:45.185016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1064/2141] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:45.198400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:45.200248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:45.309710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658fcd6-3fe7-4d41-b90e-22cffdabd891 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:45.316035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1548b6-0959-4e55-b58f-afbae4b7d969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:45.317662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1548b6-0959-4e55-b58f-afbae4b7d969 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:45.317662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1548b6-0959-4e55-b58f-afbae4b7d969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:45.317662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1548b6-0959-4e55-b58f-afbae4b7d969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:45.329776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1548b6-0959-4e55-b58f-afbae4b7d969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:45.331360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1548b6-0959-4e55-b58f-afbae4b7d969 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:45.362901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1078/2142] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:46.111887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:46.113832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:46.240482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302900-88ba-4e2c-bd6a-141b4f2b47cc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.259927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.260711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.261065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.261429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] PATH_INFO: `/v3/projects/83705283d37b4584a1f6801a06c007ad` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.263548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83705283d37b4584a1f6801a06c007ad)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:46.266420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:46.426082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83705283d37b4584a1f6801a06c007ad', 'request_id': 'req-5dbabea8-d1ea-46c9-af22-642447da148e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:46.598639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83705283d37b4584a1f6801a06c007ad', 'request_id': 'req-5dbabea8-d1ea-46c9-af22-642447da148e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:46.618224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83705283d37b4584a1f6801a06c007ad', 'request_id': 'req-5dbabea8-d1ea-46c9-af22-642447da148e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:46.664087 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:46.683399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] The token cache is being invalidate because project 83705283d37b4584a1f6801a06c007ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:46.683698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:46.687775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5dbabea8-d1ea-46c9-af22-642447da148e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:46.693893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1065/2143] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:46 2022] DELETE /identity/v3/projects/83705283d37b4584a1f6801a06c007ad => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:46.700040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.700552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.701260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.765150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:46.766704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:46.943436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:46.968715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1079/2144] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:46.977120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.977403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.977678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.029391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:47.036625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:47.055141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1066/2145] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:47.059326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:47.072868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada7977-d36d-4ac8-b636-5de231befc61 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:47.084384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:47.085028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.085309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.085585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.086263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:47.086568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:47.088230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:47.129760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1080/2146] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:47.134646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:47.146363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff66fd-91b2-4f1c-9754-bbb67ff0ef2f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:47.153173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:47.153817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.154103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.154383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.155083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:47.157658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:47.331697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1067/2147] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:47.337795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:47.357445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442d7aa-612f-418b-ae3b-e8015758182b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:47.553215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:47.559354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:47.559354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.559354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.559354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.559865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:47.563554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:47.701633 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1081/2148] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:47 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:47.705685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:47.721698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c41dd-39b0-4e16-ab65-d1a08f332cc5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:47.727776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:47.728592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.728962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.729310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.732191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:47.735221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:47.760485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1068/2149] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:47.761138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:47.774728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6ebf6-e122-407f-ba1b-6a3f7456ec48 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:47.779738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f2333-a43b-4e8a-8a9f-34d607bae645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:47.780405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2333-a43b-4e8a-8a9f-34d607bae645 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.780685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2333-a43b-4e8a-8a9f-34d607bae645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.780961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2333-a43b-4e8a-8a9f-34d607bae645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.781614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f2333-a43b-4e8a-8a9f-34d607bae645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:47.783463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f2333-a43b-4e8a-8a9f-34d607bae645 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:47.801431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1082/2150] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:47.802728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:47.814445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c8177-ca1a-4c12-939d-3065364baa96 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:47.819449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:47.820225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.820614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.820955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] PATH_INFO: `/v3/projects/b2f2590324294c8b95beddfc6a6aa05e/users/1d52633b5b7d46b39abe9e449f52d4b2/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:47.844847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f2590324294c8b95beddfc6a6aa05e, user_id=1d52633b5b7d46b39abe9e449f52d4b2, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:47.847669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:47.959658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1069/2151] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:47 2022] PUT /identity/v3/projects/b2f2590324294c8b95beddfc6a6aa05e/users/1d52633b5b7d46b39abe9e449f52d4b2/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:41:47.971479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:47.972188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:47.976557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:48.038227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] MFA Rules not processed for user `1d52633b5b7d46b39abe9e449f52d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:48.039896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:48.144174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1083/2152] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:48.151481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:48.154071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:48.300673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d00be-50eb-481a-a1a0-63458f856bcd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:48.315220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae612f-725e-4dce-ba97-5f5017d948f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:48.317386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae612f-725e-4dce-ba97-5f5017d948f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:48.317845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae612f-725e-4dce-ba97-5f5017d948f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:48.318308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae612f-725e-4dce-ba97-5f5017d948f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:48.338643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae612f-725e-4dce-ba97-5f5017d948f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:48.340452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae612f-725e-4dce-ba97-5f5017d948f0 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:48.357084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1070/2153] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:48.378870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:48.504536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41130-a515-49cc-9b07-40d65029c9f7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:48.511297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:48.512258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:48.512771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:48.513569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] PATH_INFO: `/v3/users/1d52633b5b7d46b39abe9e449f52d4b2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:48.515965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d52633b5b7d46b39abe9e449f52d4b2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:48.518503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:48.783886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d52633b5b7d46b39abe9e449f52d4b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:48.784976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d52633b5b7d46b39abe9e449f52d4b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:48.789609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:48.809156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d52633b5b7d46b39abe9e449f52d4b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:48.913960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d52633b5b7d46b39abe9e449f52d4b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:48.913960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d52633b5b7d46b39abe9e449f52d4b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:48.942865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1084/2154] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:48 2022] DELETE /identity/v3/users/1d52633b5b7d46b39abe9e449f52d4b2 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:48.944963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286178b-b7e2-4ccb-af48-4f5e90c3bf5f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:48.944963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286178b-b7e2-4ccb-af48-4f5e90c3bf5f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:48.945207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286178b-b7e2-4ccb-af48-4f5e90c3bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:48.983215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9286178b-b7e2-4ccb-af48-4f5e90c3bf5f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:48.990680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9286178b-b7e2-4ccb-af48-4f5e90c3bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:49.118939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1071/2155] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:49.126955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:49.131331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.133661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:49.261203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.261668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.261751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.286263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:49.288479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:49.332666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2294-6d56-4a42-9af9-4e10dd09a412 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.343942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.344702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.344987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.345264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.368942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:49.369958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1072/2156] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:49.370543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:49.387283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1085/2157] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:49.390147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.397752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:49.578601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfd8e4-2e6d-45cb-938c-a0590030a136 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.584018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc845153-951e-41d8-a98b-f6b51e9c804a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.584643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc845153-951e-41d8-a98b-f6b51e9c804a service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.584922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc845153-951e-41d8-a98b-f6b51e9c804a service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.585193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc845153-951e-41d8-a98b-f6b51e9c804a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.595483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc845153-951e-41d8-a98b-f6b51e9c804a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:49.597089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc845153-951e-41d8-a98b-f6b51e9c804a service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:49.607548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1073/2158] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:41:50.243748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:50.245876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:50.268714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09822ab-d1d0-4f0e-98ae-ab56e6711633 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:50.285670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:50.287130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:50.287568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:50.287995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] PATH_INFO: `/v3/projects/b2f2590324294c8b95beddfc6a6aa05e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:50.291897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f2590324294c8b95beddfc6a6aa05e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:50.294948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:50.475970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f2590324294c8b95beddfc6a6aa05e', 'request_id': 'req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:50.599368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f2590324294c8b95beddfc6a6aa05e', 'request_id': 'req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:50.609280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f2590324294c8b95beddfc6a6aa05e', 'request_id': 'req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:50.625137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] The token cache is being invalidate because project b2f2590324294c8b95beddfc6a6aa05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:50.625440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:50.626649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-06f530c8-e2de-4d1b-9d2a-0b4f61380acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:50.628203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1086/2159] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:50 2022] DELETE /identity/v3/projects/b2f2590324294c8b95beddfc6a6aa05e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:50.641195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:50.641767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:50.642170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:50.670836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:50.673344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:50.763921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1074/2160] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:50.775070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:50.775403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:50.775710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:50.799318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:50.800766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:50.809932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1087/2161] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:50.814656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:50.824037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f30412-fc4a-446c-9ab6-1850963c29ab None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:50.829650 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:50.830275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:50.830555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:50.830862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:50.831698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:50.832033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:50.833690 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:50.853048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1075/2162] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:50.857266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:50.867568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55c38-d608-4bda-a7d0-639eb04ab495 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:50.873124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:50.873744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:50.874662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:50.875166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:50.875795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:50.877735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:51.219453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1088/2163] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:50 2022] POST /identity/v3/projects => generated 361 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:51.228148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:51.240591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc31e-d514-462d-99a2-a4453ff66f5a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:51.304612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:51.305231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.313215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.313215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.313215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:51.313215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:51.613598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1076/2164] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:51 2022] POST /identity/v3/users => generated 281 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:51.617111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:51.628002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c0b8-b5bf-4764-9ffa-266cc2d1797d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:51.633162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:51.633755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.634201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.634468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.635162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:51.636747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:51.648529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1089/2165] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:51.652732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:51.665605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f12c-f69b-41f5-9a8c-ad826c2487a7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:51.670411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf81c3-fde5-47b5-a056-25402706a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:51.671074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf81c3-fde5-47b5-a056-25402706a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.671435 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf81c3-fde5-47b5-a056-25402706a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.671620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf81c3-fde5-47b5-a056-25402706a3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.672388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf81c3-fde5-47b5-a056-25402706a3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:51.674040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf81c3-fde5-47b5-a056-25402706a3ab admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:51.685282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1077/2166] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:41:51.690027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:51.700738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693a8be-1701-4c42-a7eb-a7a5dc3836d4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:51.705978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:51.706749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.707034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.707308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] PATH_INFO: `/v3/projects/db704a0bc0b84dce9f8789f156a07d30/users/70d546adaa734e78b9ccbecbc7181492/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.721996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=db704a0bc0b84dce9f8789f156a07d30, user_id=70d546adaa734e78b9ccbecbc7181492, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:51.724752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:51.853658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1090/2167] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:51 2022] PUT /identity/v3/projects/db704a0bc0b84dce9f8789f156a07d30/users/70d546adaa734e78b9ccbecbc7181492/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:51.866276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.866276 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.866593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.902379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] MFA Rules not processed for user `70d546adaa734e78b9ccbecbc7181492`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:51.904041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:51.923425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:51.999661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1078/2168] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:52.036396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.038176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:52.173910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202866-487d-4597-8c4b-9a0483d8f4de admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.177766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e833a-6e0e-42a5-bb5c-9ed371e09655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.178667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e833a-6e0e-42a5-bb5c-9ed371e09655 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.179196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e833a-6e0e-42a5-bb5c-9ed371e09655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.179719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e833a-6e0e-42a5-bb5c-9ed371e09655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.201890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e833a-6e0e-42a5-bb5c-9ed371e09655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:52.203974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e833a-6e0e-42a5-bb5c-9ed371e09655 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:52.219577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1091/2169] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:52.235728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.331162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd4a05-27a0-4b59-9f45-7ed8a8a1c0d4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.340439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.341326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.341731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.342093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] PATH_INFO: `/v3/users/70d546adaa734e78b9ccbecbc7181492` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.345047 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d546adaa734e78b9ccbecbc7181492)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:52.347268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:52.714653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d546adaa734e78b9ccbecbc7181492'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:52.766489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d546adaa734e78b9ccbecbc7181492'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:52.771340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d546adaa734e78b9ccbecbc7181492'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:52.921168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d546adaa734e78b9ccbecbc7181492'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:52.931238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d546adaa734e78b9ccbecbc7181492'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:52.947335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1079/2170] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:52 2022] DELETE /identity/v3/users/70d546adaa734e78b9ccbecbc7181492 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:52.951686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955bd70-c88a-4b9c-8bb2-c3acd7c02d32 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.953531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955bd70-c88a-4b9c-8bb2-c3acd7c02d32 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.953892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955bd70-c88a-4b9c-8bb2-c3acd7c02d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.990319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a955bd70-c88a-4b9c-8bb2-c3acd7c02d32 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:52.994414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a955bd70-c88a-4b9c-8bb2-c3acd7c02d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:53.114921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1092/2171] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:53.126365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:53.128784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:53.253286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1b2c6-5c4d-4946-97f4-72a122df2ebc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:53.269421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:53.273717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:53.273717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:53.274274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:53.303755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:53.309242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:53.336253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1080/2172] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:53.619729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:53.619729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:53.619729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:53.704291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:53.706610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:53.841998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1093/2173] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:41:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:53.856615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:53.859093 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:53.973934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa6c0e-c143-4c30-a16e-f5cdc472eb0a service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:53.996387 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840f1fd-a0cb-45ea-a704-b2a42d2867a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:53.997282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840f1fd-a0cb-45ea-a704-b2a42d2867a1 service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:54.001222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840f1fd-a0cb-45ea-a704-b2a42d2867a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:54.001222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840f1fd-a0cb-45ea-a704-b2a42d2867a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:54.012747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840f1fd-a0cb-45ea-a704-b2a42d2867a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:54.017975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840f1fd-a0cb-45ea-a704-b2a42d2867a1 service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:54.051891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1081/2174] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:41:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:41:54.259080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:54.259080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:54.282522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1eac4-fdc4-4c5f-988f-40b80cd5e554 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:54.299625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:54.300488 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:54.300929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:54.301270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] PATH_INFO: `/v3/projects/db704a0bc0b84dce9f8789f156a07d30` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:54.302996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db704a0bc0b84dce9f8789f156a07d30)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:54.305556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:54.390353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:54.507725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db704a0bc0b84dce9f8789f156a07d30', 'request_id': 'req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:54.583854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db704a0bc0b84dce9f8789f156a07d30', 'request_id': 'req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:54.591838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db704a0bc0b84dce9f8789f156a07d30', 'request_id': 'req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:54.626727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] The token cache is being invalidate because project db704a0bc0b84dce9f8789f156a07d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:54.627043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:54.627725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-513a0a72-3cf0-4654-bc5e-b0e2282c9da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:54.635759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1094/2175] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:54 2022] DELETE /identity/v3/projects/db704a0bc0b84dce9f8789f156a07d30 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:54.640796 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:54.641062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:54.641345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:54.679826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:54.681017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:55.065494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1082/2176] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:55.073269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:55.073580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:55.073835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:55.198114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:55.200491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:55.256955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1095/2177] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:55.261344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:55.288489 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7f30-3e26-4c70-a88a-684e73c02c3b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:55.313883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:55.314583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:55.314965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:55.316185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:55.318314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:55.318713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:55.320389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:55.394604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1083/2178] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:55.396259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:55.414340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6901e-069a-48f5-975a-ba75023e702d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:55.439932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:55.440780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:55.441236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:55.442899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:55.447366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:55.449675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:55.520825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:55.624386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1096/2179] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:55 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:55.630062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:55.650722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071612-bc59-4c89-9a86-b62f48db279e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:55.887427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:55.937399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:55.938394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:55.939104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:55.940284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:55.955046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:55.966571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:56.196047 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1084/2180] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:55 2022] POST /identity/v3/users => generated 288 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:56.198555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:56.216554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f315-44bd-41f8-ada3-1b9da3665ad8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:56.250541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:56.252645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:56.255161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:56.255715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:56.256738 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:56.263014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:56.338305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:56.346904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1097/2181] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:56.391977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:56.482596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106e01-6800-4b31-a28b-404daef8071d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:56.499312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:56.500130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:56.500530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:56.500902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:56.501755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:56.503602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:56.539125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:56.540391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1085/2182] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:41:56.558900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b280b-8574-4fa7-89cc-e415d73f705b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:56.577431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a875be-4a66-4b49-a606-fb1e2e1b1a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:56.578744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a875be-4a66-4b49-a606-fb1e2e1b1a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:56.578744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a875be-4a66-4b49-a606-fb1e2e1b1a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:56.579184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a875be-4a66-4b49-a606-fb1e2e1b1a62 admin admin] PATH_INFO: `/v3/projects/79142d91d2d34048a8eeb93063aa8579/users/0abf7b97f9f34dd2a9d559e59c08f4ce/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:56.611874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a875be-4a66-4b49-a606-fb1e2e1b1a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79142d91d2d34048a8eeb93063aa8579, user_id=0abf7b97f9f34dd2a9d559e59c08f4ce, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:56.627661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a875be-4a66-4b49-a606-fb1e2e1b1a62 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:56.920191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:56.928179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:56.951635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc238c1-6e85-423b-af5c-935996493f0a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:56.976764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:56.977446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:56.977735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:56.978012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] PATH_INFO: `/v3/users/ae65ed8bf75d49f2878b39d6a9d08347` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:56.982145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae65ed8bf75d49f2878b39d6a9d08347)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:56.986448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:56.998309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1098/2183] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:41:56 2022] PUT /identity/v3/projects/79142d91d2d34048a8eeb93063aa8579/users/0abf7b97f9f34dd2a9d559e59c08f4ce/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:57.004821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:57.005176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:57.006746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:57.044732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] MFA Rules not processed for user `0abf7b97f9f34dd2a9d559e59c08f4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:57.046714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:57.173801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1099/2184] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:57.186258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:57.188619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:57.292578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d44ce6-4d85-44f8-b1bd-5e6f5cc48d58 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:57.296928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:57.297871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:57.298676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:57.299151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:57.313609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:57.315177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:57.326039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1100/2185] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:57.352793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae65ed8bf75d49f2878b39d6a9d08347'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:57.383217 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae65ed8bf75d49f2878b39d6a9d08347'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:57.383953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae65ed8bf75d49f2878b39d6a9d08347'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:57.514934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae65ed8bf75d49f2878b39d6a9d08347'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:57.515516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:57.524782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-47c13f83-a6db-4920-a129-dfc34632c362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae65ed8bf75d49f2878b39d6a9d08347'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:57.546222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1086/2186] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:41:56 2022] DELETE /identity/v3/users/ae65ed8bf75d49f2878b39d6a9d08347 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:41:58.033190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:58.192683 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f226e5-49df-423e-aa1a-07d332faea59 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:58.321388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:58.322302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:58.324079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:58.324079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] PATH_INFO: `/v3/projects/48ad0f41cd0a42a98737d08cf4efb61c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:58.324837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ad0f41cd0a42a98737d08cf4efb61c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:58.327581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:58.506426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ad0f41cd0a42a98737d08cf4efb61c', 'request_id': 'req-163111e3-1c4d-4fe4-9474-0e22e3ce3072'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:58.687631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ad0f41cd0a42a98737d08cf4efb61c', 'request_id': 'req-163111e3-1c4d-4fe4-9474-0e22e3ce3072'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:58.715736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ad0f41cd0a42a98737d08cf4efb61c', 'request_id': 'req-163111e3-1c4d-4fe4-9474-0e22e3ce3072'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:58.761420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] The token cache is being invalidate because project 48ad0f41cd0a42a98737d08cf4efb61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:41:58.761420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:58.761420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-163111e3-1c4d-4fe4-9474-0e22e3ce3072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:41:58.766767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1101/2187] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:41:58 2022] DELETE /identity/v3/projects/48ad0f41cd0a42a98737d08cf4efb61c => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:58.782718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:58.783282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:58.783282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:58.813831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:58.815117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:58.919008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1087/2188] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:41:58.934072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:58.938263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:58.938582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:58.964155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:58.965416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:58.979422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1102/2189] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:58.981126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:59.045930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87697971-ea65-41a3-bd7b-cc5873020c99 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:59.045930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:59.045930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:59.047447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:59.048835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:59.049596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:59.051023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:59.053399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02365d30-512d-410d-820d-42329b48c149 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:59.070138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1088/2190] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:59.074933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:59.088039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa931d2-e3a1-43c0-98fa-a7288ec07fef None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:59.094729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:59.095493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:59.095967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:59.096158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:59.097353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:59.099385 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:59.808813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:59.827475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:59.828055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:59.828400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:59.831602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1103/2191] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:41:59 2022] POST /identity/v3/projects => generated 395 bytes in 757 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:41:59.842183 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:59.887952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] MFA Rules not processed for user `0b8cfe691e0848d880fb4d88e15f9abd`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:59.892334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:59.925198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40d349-67d0-4391-bbaa-a0b7794039a4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:59.939730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:59.941685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:59.941685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:59.941685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:59.942001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:59.944026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:00.008596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1089/2192] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:41:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:42:00.088470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1104/2193] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:41:59 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:00.093024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:00.112055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bebe19-8dad-48df-9e49-ca9a5cfa6c4a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:00.118939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:00.124850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:00.129735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:00.130309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:00.131267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:00.133642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:00.160766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:00.168534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1090/2194] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:00.174475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d80f2-d2ff-4a88-81b0-d8983765229b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:00.183458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05760c-f756-401d-b785-a87c8edd4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:00.184526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05760c-f756-401d-b785-a87c8edd4666 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:00.184979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05760c-f756-401d-b785-a87c8edd4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:00.185414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05760c-f756-401d-b785-a87c8edd4666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:00.186834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05760c-f756-401d-b785-a87c8edd4666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:00.189121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05760c-f756-401d-b785-a87c8edd4666 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:00.207637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:00.216781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1105/2195] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:00.222682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7ced5-2038-4e8a-a364-2f710d353ef1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:00.249177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:00.250573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:00.251266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:00.251770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] PATH_INFO: `/v3/projects/4060328056b543e1a6cf66ec027f9484/users/4cb63b784b2f4d3ba61d09929ff6cd93/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:00.281655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4060328056b543e1a6cf66ec027f9484, user_id=4cb63b784b2f4d3ba61d09929ff6cd93, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:00.282408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:00.418439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:00.429313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1091/2196] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:42:00 2022] PUT /identity/v3/projects/4060328056b543e1a6cf66ec027f9484/users/4cb63b784b2f4d3ba61d09929ff6cd93/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:00.439995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:00.440611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:00.440899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:00.484127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] MFA Rules not processed for user `4cb63b784b2f4d3ba61d09929ff6cd93`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:00.486710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:00.629370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1106/2197] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:00.644971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:00.647142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:00.774426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbad9-f9ff-4b67-a978-c34efaff337f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:00.784393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ca81c-234f-4ab3-8f25-d4f2cf1a30dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:00.787987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ca81c-234f-4ab3-8f25-d4f2cf1a30dc service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:00.787987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ca81c-234f-4ab3-8f25-d4f2cf1a30dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:00.787987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ca81c-234f-4ab3-8f25-d4f2cf1a30dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:00.803106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ca81c-234f-4ab3-8f25-d4f2cf1a30dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:00.804892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ca81c-234f-4ab3-8f25-d4f2cf1a30dc service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:00.828332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1092/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:01.983741 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:02.229844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:02.622975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:02.625336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:02.813178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1855e-420c-45cf-a047-ef5081e6a67a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:02.827576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:02.828746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:02.829224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:02.829806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] PATH_INFO: `/v3/users/1116a8ba73bb4e7d94db170e04303794` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:02.855043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1116a8ba73bb4e7d94db170e04303794)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:02.867949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:03.164230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1116a8ba73bb4e7d94db170e04303794'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:03.169695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1116a8ba73bb4e7d94db170e04303794'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:03.203294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1116a8ba73bb4e7d94db170e04303794'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:03.360494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1116a8ba73bb4e7d94db170e04303794'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:03.361496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1116a8ba73bb4e7d94db170e04303794'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:03.402135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1107/2199] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:42:02 2022] DELETE /identity/v3/users/1116a8ba73bb4e7d94db170e04303794 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:03.403516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:03.403991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:03.404118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:03.433884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:03.435467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:03.549880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1093/2200] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:42:03.561438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:03.563035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:03.745410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea1d6-3fb2-4927-b662-902e8ebdca12 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:03.750149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:03.750879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:03.751165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:03.751576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:03.772952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:03.778072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:03.796626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1108/2201] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:04.280463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:04.281966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:04.307597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf265e-2262-4f6c-bbb7-e9fea26abbc4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:04.316629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:04.317419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:04.317773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:04.318118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] PATH_INFO: `/v3/users/0abf7b97f9f34dd2a9d559e59c08f4ce` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:04.323670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abf7b97f9f34dd2a9d559e59c08f4ce)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:04.326030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:05.140997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:05.156588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:05.158860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ba214-598c-4bc4-9023-5cb8c2f039f7 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:05.164955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:05.165640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:05.430297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:05.430297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] PATH_INFO: `/v3/projects/63f0f783d3cd447da44618951f90eca2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:05.430297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f0f783d3cd447da44618951f90eca2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:05.430297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:05.492634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abf7b97f9f34dd2a9d559e59c08f4ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.516199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abf7b97f9f34dd2a9d559e59c08f4ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.516940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abf7b97f9f34dd2a9d559e59c08f4ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.760993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f0f783d3cd447da44618951f90eca2', 'request_id': 'req-c85ea9bb-49bc-4bb2-b991-0d664acb296f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.836880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abf7b97f9f34dd2a9d559e59c08f4ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.848114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f8bd19aa-536e-44b1-b0c3-c0c2f75fe060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abf7b97f9f34dd2a9d559e59c08f4ce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.859865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1094/2202] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:42:04 2022] DELETE /identity/v3/users/0abf7b97f9f34dd2a9d559e59c08f4ce => generated 0 bytes in 1576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:05.863288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:05.863889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:05.864529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:05.893777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:05.896139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:05.955695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f0f783d3cd447da44618951f90eca2', 'request_id': 'req-c85ea9bb-49bc-4bb2-b991-0d664acb296f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:05.965679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f0f783d3cd447da44618951f90eca2', 'request_id': 'req-c85ea9bb-49bc-4bb2-b991-0d664acb296f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:06.006977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] The token cache is being invalidate because project 63f0f783d3cd447da44618951f90eca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:42:06.007663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:06.009340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c85ea9bb-49bc-4bb2-b991-0d664acb296f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:06.026369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1109/2203] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:42:05 2022] DELETE /identity/v3/projects/63f0f783d3cd447da44618951f90eca2 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:42:06.034738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1095/2204] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:06.043872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:06.046619 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:06.204204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e03f01-0311-4f74-856f-64507c1ca811 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:06.216845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:06.219701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:06.221211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:06.223029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:06.245913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:06.248378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:06.277353 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1096/2205] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:06.791439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:06.876106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:06.876781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:06.877286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:06.929940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:06.935091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:06.962945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:06.964583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:06.992006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c20468-3291-4398-a026-88b8d9a2cc37 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:06.997360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:07.012059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:07.012358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:07.012787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] PATH_INFO: `/v3/projects/79142d91d2d34048a8eeb93063aa8579` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:07.016897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79142d91d2d34048a8eeb93063aa8579)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:07.024878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:07.065260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1110/2206] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:42:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:07.081813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:07.086230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:07.132938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:07.239989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eecfd4-d5f9-4260-aee0-e8c7ca640736 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:07.249994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79142d91d2d34048a8eeb93063aa8579', 'request_id': 'req-82dab900-2313-4e31-9f67-7a85bc3a8f73'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:07.364724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52108975-7218-4514-949b-c3f1c686b20e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:07.365041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52108975-7218-4514-949b-c3f1c686b20e service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:07.365431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52108975-7218-4514-949b-c3f1c686b20e service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:07.366009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52108975-7218-4514-949b-c3f1c686b20e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:07.366785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79142d91d2d34048a8eeb93063aa8579', 'request_id': 'req-82dab900-2313-4e31-9f67-7a85bc3a8f73'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:07.376887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79142d91d2d34048a8eeb93063aa8579', 'request_id': 'req-82dab900-2313-4e31-9f67-7a85bc3a8f73'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:07.403243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] The token cache is being invalidate because project 79142d91d2d34048a8eeb93063aa8579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:42:07.405861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:07.405861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82dab900-2313-4e31-9f67-7a85bc3a8f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:07.416139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1097/2207] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:42:06 2022] DELETE /identity/v3/projects/79142d91d2d34048a8eeb93063aa8579 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:42:07.420678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:07.421806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:07.421957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:07.448957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:07.457590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:07.460602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52108975-7218-4514-949b-c3f1c686b20e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:07.462862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52108975-7218-4514-949b-c3f1c686b20e service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:07.477640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1111/2208] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:42:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:42:07.554405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1098/2209] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:07.564397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:07.565057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:07.565416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:07.594553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:07.607833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:07.638309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1112/2210] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:07.642537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:07.660359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c38113-58e8-41a2-861c-68202fb1a230 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:07.680326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:07.681181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:07.682233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:07.682443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:07.683150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:07.683465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:07.685089 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:07.699037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1099/2211] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:07.705105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:07.720536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470eeb0-2e4d-4fd9-a73d-03954cbaec62 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:07.728020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:07.730142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:07.730142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:07.730142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:07.730728 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:07.735402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:07.902423 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1113/2212] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:42:07 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:07.909688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:07.938868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb7c8-eea4-4e45-b3a4-6b5388af0fd7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:08.146114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:08.146851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:08.147391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:08.147758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:08.148392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:08.152074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:08.247081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1100/2213] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:42:07 2022] POST /identity/v3/users => generated 287 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:08.252179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:08.271628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca8e2b-844b-4e08-907f-f7b16588503c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:08.287422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:08.288109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:08.291331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:08.291847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:08.293485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:08.300971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:08.320968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:08.337192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1114/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:08.341570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:08.363883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdaad2-935d-4534-a431-b81ce8407027 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:08.385275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea648-16fa-4d34-9f45-9a135fa6d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:08.386596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea648-16fa-4d34-9f45-9a135fa6d10f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:08.387337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea648-16fa-4d34-9f45-9a135fa6d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:08.387767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea648-16fa-4d34-9f45-9a135fa6d10f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:08.392984 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ea648-16fa-4d34-9f45-9a135fa6d10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:08.394749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ea648-16fa-4d34-9f45-9a135fa6d10f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:08.429582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:08.445689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1101/2215] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:08.449927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eadce-a87f-4f9f-81ff-ad88dc4ba051 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:08.468692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:08.470637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:08.472196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:08.474142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] PATH_INFO: `/v3/projects/126e158b048e4a56a9ef5024454b21a0/users/900acd8f3ce94efcbc7e67e04705b032/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:08.526413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126e158b048e4a56a9ef5024454b21a0, user_id=900acd8f3ce94efcbc7e67e04705b032, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:08.528285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:08.659140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1115/2216] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:42:08 2022] PUT /identity/v3/projects/126e158b048e4a56a9ef5024454b21a0/users/900acd8f3ce94efcbc7e67e04705b032/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:42:08.665214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:08.665810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:08.666445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:08.736787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] MFA Rules not processed for user `900acd8f3ce94efcbc7e67e04705b032`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:08.738308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:08.914827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:08.965675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1102/2217] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:08.991632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:08.993885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:09.162544 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217e139-d4aa-473d-ba86-689c7f16f571 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:09.168781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:09.169674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:09.172021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:09.172021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:09.191789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:09.193925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:09.209387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1116/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:09.243124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:09.485870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d3b5e-1781-45de-8d43-1553b9f2903f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:09.501395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:09.508511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:09.508511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:09.508511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] PATH_INFO: `/v3/users/900acd8f3ce94efcbc7e67e04705b032` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:09.508511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=900acd8f3ce94efcbc7e67e04705b032)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:09.512166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:09.556791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:09.560259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:09.602506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654c7c-fa16-4760-b716-eecf509a8ca9 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:09.617585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:09.618653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:09.619181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:09.619694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] PATH_INFO: `/v3/users/4cb63b784b2f4d3ba61d09929ff6cd93` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:09.621381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb63b784b2f4d3ba61d09929ff6cd93)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:09.623696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:10.004258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900acd8f3ce94efcbc7e67e04705b032'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.052138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb63b784b2f4d3ba61d09929ff6cd93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.055464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb63b784b2f4d3ba61d09929ff6cd93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.064586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900acd8f3ce94efcbc7e67e04705b032'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.066125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900acd8f3ce94efcbc7e67e04705b032'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.086101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb63b784b2f4d3ba61d09929ff6cd93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.718069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900acd8f3ce94efcbc7e67e04705b032'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.728701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f923a2ce-33b3-4d61-af4d-75e119441dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900acd8f3ce94efcbc7e67e04705b032'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.737277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1103/2219] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:42:09 2022] DELETE /identity/v3/users/900acd8f3ce94efcbc7e67e04705b032 => generated 0 bytes in 1494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:10.741426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:10.741722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:10.741993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:10.762516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:10.764026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:10.802729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb63b784b2f4d3ba61d09929ff6cd93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.802729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9bd7956-a3ef-4341-8b23-b61d92f6d19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb63b784b2f4d3ba61d09929ff6cd93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:10.823963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1117/2220] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:42:09 2022] DELETE /identity/v3/users/4cb63b784b2f4d3ba61d09929ff6cd93 => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:10.829449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:10.829560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:10.829771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:10.869914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:10.873476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1104/2221] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:42:10.880160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:10.880872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:10.881705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:10.955538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:10.999209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2109f55-64e0-45cc-9483-c2c64fa51132 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.046140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1118/2222] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:11.053140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:11.057362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:11.121918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.123022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.123574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.124230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.143924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.143924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.155807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1105/2223] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:42:11.204378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e25a2a-5eb1-4602-abbd-3e4573ac8416 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.213858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.214504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.214993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.215271 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.250842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.252587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.284229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1119/2224] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:42:11.531351 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.236863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:12.238420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.252847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c1a1b-6e5c-450b-ae49-85fbbd4bf7bf service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:12.257933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:12.258592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:12.259270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:12.259270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] PATH_INFO: `/v3/projects/4060328056b543e1a6cf66ec027f9484` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:12.260385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4060328056b543e1a6cf66ec027f9484)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:12.262312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:12.383997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.453164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.461028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4060328056b543e1a6cf66ec027f9484', 'request_id': 'req-98067763-054a-405f-8f54-e05dfafd5fd4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.612267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4060328056b543e1a6cf66ec027f9484', 'request_id': 'req-98067763-054a-405f-8f54-e05dfafd5fd4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.623137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4060328056b543e1a6cf66ec027f9484', 'request_id': 'req-98067763-054a-405f-8f54-e05dfafd5fd4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.653901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] The token cache is being invalidate because project 4060328056b543e1a6cf66ec027f9484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:42:12.654196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.656692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-98067763-054a-405f-8f54-e05dfafd5fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.674775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1106/2225] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:42:12 2022] DELETE /identity/v3/projects/4060328056b543e1a6cf66ec027f9484 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:12.866155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:12.868350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.893190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c31c4-ffc6-4e8f-931a-b95da76a8e53 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.010049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.010884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.015401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.015401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] PATH_INFO: `/v3/projects/126e158b048e4a56a9ef5024454b21a0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.039951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126e158b048e4a56a9ef5024454b21a0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:13.044802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:13.274482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126e158b048e4a56a9ef5024454b21a0', 'request_id': 'req-d18b93cd-6a80-498a-b7b0-9d904e218258'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.385851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126e158b048e4a56a9ef5024454b21a0', 'request_id': 'req-d18b93cd-6a80-498a-b7b0-9d904e218258'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.398912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126e158b048e4a56a9ef5024454b21a0', 'request_id': 'req-d18b93cd-6a80-498a-b7b0-9d904e218258'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.414177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] The token cache is being invalidate because project 126e158b048e4a56a9ef5024454b21a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:42:13.414756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.415549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d18b93cd-6a80-498a-b7b0-9d904e218258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.422319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1120/2226] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:42:12 2022] DELETE /identity/v3/projects/126e158b048e4a56a9ef5024454b21a0 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:13.423909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.424545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.424641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.454568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:13.456212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:13.529767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1107/2227] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:13.539389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.539673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.539950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.577931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:13.579329 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:13.587449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1121/2228] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:13.591963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:13.602539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cab775-f808-4a0c-bece-c973497d37c5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.607602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.608613 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.608974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.609303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.610041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:13.610422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:13.612390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:13.631750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1108/2229] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:13.632858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:13.645319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0372cad-05ff-4f58-ba42-380fd6e39da3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.650574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.651264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.651543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.651813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.652461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:13.654381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:13.745257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1122/2230] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:42:13 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:13.750747 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:13.761883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eec75-39c6-4a0a-a323-e283311dcb77 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.845193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.846094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.846599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.846976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.847893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:13.850136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:13.961439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1109/2231] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:42:13 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:13.966246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:13.979986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641358-4285-48b7-8a44-73525b3f0363 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.986477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.987052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.987403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.987781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.988626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:14.001134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:14.004963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1123/2232] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:42:14.009078 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:14.021630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef58d-cd84-421b-9679-1da743cf66cf admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:14.027487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d4a1-2c71-409b-86a3-d424fb715c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:14.028445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d4a1-2c71-409b-86a3-d424fb715c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:14.028751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d4a1-2c71-409b-86a3-d424fb715c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:14.029228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d4a1-2c71-409b-86a3-d424fb715c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:14.030737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d4a1-2c71-409b-86a3-d424fb715c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:14.033909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d4a1-2c71-409b-86a3-d424fb715c75 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:14.054492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1110/2233] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:14.057066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:14.083070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743451dd-e569-471b-81d9-eed76d148137 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:14.088775 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:14.089465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:14.089752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:14.090060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] PATH_INFO: `/v3/projects/9acb0920ef024fb7b5e1e44eec90c445/users/322cb6fa40fd4b8883cb554897895d58/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:14.111279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9acb0920ef024fb7b5e1e44eec90c445, user_id=322cb6fa40fd4b8883cb554897895d58, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:14.114401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:14.209804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1124/2234] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:42:14 2022] PUT /identity/v3/projects/9acb0920ef024fb7b5e1e44eec90c445/users/322cb6fa40fd4b8883cb554897895d58/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:14.220769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda3e3-891c-4869-84b8-7f0a7374dcfc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:14.221171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda3e3-891c-4869-84b8-7f0a7374dcfc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:14.222659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda3e3-891c-4869-84b8-7f0a7374dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:14.268485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-73eda3e3-891c-4869-84b8-7f0a7374dcfc None None] MFA Rules not processed for user `322cb6fa40fd4b8883cb554897895d58`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:14.270228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-73eda3e3-891c-4869-84b8-7f0a7374dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:14.305024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:14.375556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1111/2235] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:14.387970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:14.393291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:14.402656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:14.475582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de43fdb-3678-44f7-bd76-65205bafe52c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:14.479664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:14.480367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:14.480721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:14.481063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:14.493966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:14.502041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:14.509499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1125/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:15.029750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:16.476815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae49197-0e35-4c0a-a71c-83a6be25df5a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:16.477625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae49197-0e35-4c0a-a71c-83a6be25df5a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:16.477625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae49197-0e35-4c0a-a71c-83a6be25df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:16.496789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3ae49197-0e35-4c0a-a71c-83a6be25df5a None None] MFA Rules not processed for user `322cb6fa40fd4b8883cb554897895d58`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:16.497998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3ae49197-0e35-4c0a-a71c-83a6be25df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:16.511052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1112/2237] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:21.499449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:21.501950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:21.588698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d228c-fffb-4764-a4cb-fecf8d91864c service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:21.595114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:21.595739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:21.596021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:21.596299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:21.598150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:21.611083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:21.612734 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587d357-fcee-4d0d-aeb8-95fc78bee09a service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:21.623694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1126/2238] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:26.547577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=25 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:29.432028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b359db6-e5cf-42f2-9303-5b3efeba2274 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:29.433510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b359db6-e5cf-42f2-9303-5b3efeba2274 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:29.433930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b359db6-e5cf-42f2-9303-5b3efeba2274 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:29.435566 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1113/2239] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:42:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:29.443298 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acda6-5323-4b31-918c-8d63898b7d3c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:29.443857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acda6-5323-4b31-918c-8d63898b7d3c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:29.443981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acda6-5323-4b31-918c-8d63898b7d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:29.465147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8a3acda6-5323-4b31-918c-8d63898b7d3c None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:29.466772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a3acda6-5323-4b31-918c-8d63898b7d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:29.553341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1127/2240] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:42:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:42:29.566299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b359db6-e5cf-42f2-9303-5b3efeba2274 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:29.568137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6b359db6-e5cf-42f2-9303-5b3efeba2274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:29.635287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b359db6-e5cf-42f2-9303-5b3efeba2274 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:29.641172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc80e3b-300a-4fc3-ac24-d3961bc593d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:29.641795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80e3b-300a-4fc3-ac24-d3961bc593d4 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:29.642073 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80e3b-300a-4fc3-ac24-d3961bc593d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:29.642343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80e3b-300a-4fc3-ac24-d3961bc593d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:29.653066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc80e3b-300a-4fc3-ac24-d3961bc593d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:29.654492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc80e3b-300a-4fc3-ac24-d3961bc593d4 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:29.666298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1114/2241] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:29.933259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd87f-b389-4925-ac27-d2f24d882d14 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:29.933553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd87f-b389-4925-ac27-d2f24d882d14 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:29.933821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd87f-b389-4925-ac27-d2f24d882d14 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:29.935225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1128/2242] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:29.940953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b256d-a71c-4319-9c2b-2b8aaabbe328 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:29.941238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b256d-a71c-4319-9c2b-2b8aaabbe328 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:29.941512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b256d-a71c-4319-9c2b-2b8aaabbe328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:29.962285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-916b256d-a71c-4319-9c2b-2b8aaabbe328 None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:29.963524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-916b256d-a71c-4319-9c2b-2b8aaabbe328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:30.034753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1115/2243] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:42:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:30.049963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd87f-b389-4925-ac27-d2f24d882d14 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:30.053452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c73bd87f-b389-4925-ac27-d2f24d882d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:30.069421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd87f-b389-4925-ac27-d2f24d882d14 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:30.073692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d040b-1999-418b-ae0b-9b373ab65f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:30.074348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d040b-1999-418b-ae0b-9b373ab65f94 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:30.074637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d040b-1999-418b-ae0b-9b373ab65f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:30.076249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d040b-1999-418b-ae0b-9b373ab65f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:30.085106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d040b-1999-418b-ae0b-9b373ab65f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:30.086584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d040b-1999-418b-ae0b-9b373ab65f94 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:30.098144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1129/2244] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:30.192444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1887-5453-45b0-9a8b-3da0e700857e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:30.193068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1887-5453-45b0-9a8b-3da0e700857e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:30.193509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1887-5453-45b0-9a8b-3da0e700857e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:30.195085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1116/2245] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:42:30.207718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9c74-f87a-4ec9-aa39-3059dfa65342 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:30.208000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9c74-f87a-4ec9-aa39-3059dfa65342 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:30.208276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9c74-f87a-4ec9-aa39-3059dfa65342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:30.229593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a0eb9c74-f87a-4ec9-aa39-3059dfa65342 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:30.230863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a0eb9c74-f87a-4ec9-aa39-3059dfa65342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:30.242370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1130/2246] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:42:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:30.258277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1887-5453-45b0-9a8b-3da0e700857e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:30.270965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1887-5453-45b0-9a8b-3da0e700857e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:30.274584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:30.275225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:30.275503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:30.275777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:30.287714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:30.289160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:30.301999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1117/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:42:35.074503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:35.074503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:35.074503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:35.088157 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:35.095031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:35.096352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:35.160552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1131/2248] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:42:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:35.184731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:35.186919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:35.273758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa4eec-0ce3-4842-b9f5-700bb6f9be63 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:35.278929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a35cc-7ce5-4e19-bc19-0c205d204f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:35.280081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a35cc-7ce5-4e19-bc19-0c205d204f07 service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:35.280493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a35cc-7ce5-4e19-bc19-0c205d204f07 service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:35.280966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a35cc-7ce5-4e19-bc19-0c205d204f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:35.290274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a35cc-7ce5-4e19-bc19-0c205d204f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:35.291907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a35cc-7ce5-4e19-bc19-0c205d204f07 service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:35.301320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1118/2249] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:42:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:42:45.183816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=22 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:45.304979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:51.927156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:51.938156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d0b75-d2b7-487e-82c7-c86fdab8ab9d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:51.944887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:51.945519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:51.945796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:51.946064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:51.947865 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:52.034115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:52.035736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:52.048009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1132/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:57.766450 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc56d0-d0f8-4740-a061-351103da4d26 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.767034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc56d0-d0f8-4740-a061-351103da4d26 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.767155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc56d0-d0f8-4740-a061-351103da4d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.814649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e7fc56d0-d0f8-4740-a061-351103da4d26 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:57.816629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e7fc56d0-d0f8-4740-a061-351103da4d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:57.824531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1119/2251] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:57.838338 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.850501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8828a-e48e-4dd2-a22a-29e97b4372ab service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.855588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.856421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.856871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.858190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.868017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.875427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.881112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1133/2252] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:43:00.745271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfa35c-b413-4bfe-97c6-4b795cdc36c2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:00.745271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfa35c-b413-4bfe-97c6-4b795cdc36c2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:00.745271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfa35c-b413-4bfe-97c6-4b795cdc36c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:00.768238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5bdfa35c-b413-4bfe-97c6-4b795cdc36c2 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:00.769699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5bdfa35c-b413-4bfe-97c6-4b795cdc36c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:00.777124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1120/2253] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:00.791393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:00.806634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8ab8-6c21-4121-bc98-66c32a1c2f64 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:00.813022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:00.813723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:00.814068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:00.814410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:00.824576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:00.826550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:00.835599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1134/2254] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:43:01.933865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb525-329c-43de-8333-1311bc9d1c7c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.933865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb525-329c-43de-8333-1311bc9d1c7c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.933865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb525-329c-43de-8333-1311bc9d1c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.955527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fe3cb525-329c-43de-8333-1311bc9d1c7c None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:01.957020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fe3cb525-329c-43de-8333-1311bc9d1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:01.965107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1121/2255] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:01.981677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:01.993424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743895f3-bc0b-404e-8a22-36dec1fda4cc service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.999659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.000474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.000824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.001166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.013017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.013158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.022339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1135/2256] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:43:02.755656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940495-565c-46d7-815a-57bb5c947444 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.755947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940495-565c-46d7-815a-57bb5c947444 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.756216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940495-565c-46d7-815a-57bb5c947444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.776593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6d940495-565c-46d7-815a-57bb5c947444 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:02.777794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6d940495-565c-46d7-815a-57bb5c947444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:02.786086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1122/2257] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:43:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:02.797961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:02.808645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dd755-2ddd-4acd-9043-553f00ab0d75 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:02.813810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.814403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.814684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.815011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.823076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.824658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.833675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1136/2258] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:43:03.582525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:03.583046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:03.583046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:03.603437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:03.604786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:03.612862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1123/2259] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:03.626982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:03.646528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecdda6-8611-4bf5-935a-468ede009410 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:03.656961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c133a-8ff6-4729-bb69-63ffc5a94b4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:03.658760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c133a-8ff6-4729-bb69-63ffc5a94b4d service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:03.659237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c133a-8ff6-4729-bb69-63ffc5a94b4d service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:03.659512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c133a-8ff6-4729-bb69-63ffc5a94b4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:03.669016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c133a-8ff6-4729-bb69-63ffc5a94b4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:03.671133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c133a-8ff6-4729-bb69-63ffc5a94b4d service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:03.680593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1137/2260] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:43:06.974738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.040453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524c511-f4e8-4ad1-935a-0c961b382bdc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.048693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.049379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.049668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.050001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] PATH_INFO: `/v3/users/322cb6fa40fd4b8883cb554897895d58` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.051428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322cb6fa40fd4b8883cb554897895d58)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.053481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.345268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322cb6fa40fd4b8883cb554897895d58'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:07.359595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322cb6fa40fd4b8883cb554897895d58'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:07.360422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322cb6fa40fd4b8883cb554897895d58'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:07.446673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322cb6fa40fd4b8883cb554897895d58'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:07.454884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322cb6fa40fd4b8883cb554897895d58'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:07.460936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1124/2261] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:43:06 2022] DELETE /identity/v3/users/322cb6fa40fd4b8883cb554897895d58 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:43:07.465456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.466029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.466127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.485648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:07.486901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:07.550169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1138/2262] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:43:07.562384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.566420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:07.633543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:07.639222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227677c0-acea-43d9-ba8e-9d916edd4ea8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.649448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ef13-9d1c-4cec-8c7d-f692f51a2361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.656735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ef13-9d1c-4cec-8c7d-f692f51a2361 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.656735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ef13-9d1c-4cec-8c7d-f692f51a2361 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.656735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ef13-9d1c-4cec-8c7d-f692f51a2361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.661573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ef13-9d1c-4cec-8c7d-f692f51a2361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.663062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ef13-9d1c-4cec-8c7d-f692f51a2361 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.673608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1125/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:43:07.945063 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.947008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:07.962327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6e10-4c3b-42b8-aea9-6577bb0bcad1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.967617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.968315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.968596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.972226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] PATH_INFO: `/v3/projects/9acb0920ef024fb7b5e1e44eec90c445` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.972226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9acb0920ef024fb7b5e1e44eec90c445)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.972226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:08.011126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:08.113023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9acb0920ef024fb7b5e1e44eec90c445', 'request_id': 'req-165f0021-f689-4e09-9eb4-e466155461ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:08.315229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9acb0920ef024fb7b5e1e44eec90c445', 'request_id': 'req-165f0021-f689-4e09-9eb4-e466155461ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:08.324261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9acb0920ef024fb7b5e1e44eec90c445', 'request_id': 'req-165f0021-f689-4e09-9eb4-e466155461ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:08.336974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] The token cache is being invalidate because project 9acb0920ef024fb7b5e1e44eec90c445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:43:08.384002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:08.384002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-165f0021-f689-4e09-9eb4-e466155461ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:43:08.384002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1139/2264] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:43:07 2022] DELETE /identity/v3/projects/9acb0920ef024fb7b5e1e44eec90c445 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:43:10.431736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbaec0-f38e-454c-9f4a-5d18d8513efd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:10.432256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbaec0-f38e-454c-9f4a-5d18d8513efd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:10.432359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbaec0-f38e-454c-9f4a-5d18d8513efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:10.452839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-09cbaec0-f38e-454c-9f4a-5d18d8513efd None None] MFA Rules not processed for user `e1942539e3374378b0b3d7942f6304b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:10.454045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-09cbaec0-f38e-454c-9f4a-5d18d8513efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:10.508677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1126/2265] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:43:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:18.333319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:20.502142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=30 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:28.039048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:28.040011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:28.040289 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:28.062549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] MFA Rules not processed for user `e9b3debecd8c402a86fb2ad133bdd7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:28.067412 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:28.138837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1140/2266] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:43:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:38.129410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=25 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:53.780240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:53.783281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:53.783281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:53.800955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] MFA Rules not processed for user `fbc1fd78028a4b1c91b7ff29ecd4b6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:53.802161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:53.858845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1127/2267] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:03.851212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=25 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:30.311849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:30.314851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:30.434671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b052f5-df44-4ca7-bbb9-ac91d75ce012 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:30.444092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:30.446163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:30.446677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:30.447218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:30.453989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:30.472753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:30.474729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a399-e1c5-45b0-a376-eb2042ae81d1 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:30.487405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1141/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:44:38.461617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:38.463346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:38.569798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04d1d-1cab-41ec-8c8e-e7435efb303e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:38.578107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:38.579270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:38.579939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:38.580416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:38.583754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:38.623873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:38.626973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:38.652040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1128/2269] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:44:38.985192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:38.985807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:38.986235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:39.016526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] MFA Rules not processed for user `e1942539e3374378b0b3d7942f6304b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:39.018897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:39.031902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1142/2270] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:40.025286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:40.040139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6c6cb-9544-4238-a127-0f3807b222a1 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:40.049159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:40.050641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:40.050641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:40.050641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:40.053592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:40.068984 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:40.070679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c81f4-e81e-404f-848c-7f93548af256 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:40.084103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1129/2271] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:41.066143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:41.067969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:41.082959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393c5d-bbc6-4c3e-a061-3cf345df83a9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:41.086726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:41.087383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:41.087665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:41.087940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:41.089788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:41.106043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:41.112877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:41.119704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1143/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:44:44.852927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:44.853816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:44.853816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:44.879075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:44.881234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:44.966823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1130/2273] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:45.190429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:45.193099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:45.239716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:45.252617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff485339-ea19-4a4a-8b50-1dc036b86eb7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:45.259539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:45.260562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:45.261051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:45.261512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:45.265716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:45.351131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa62c0-8425-4e68-8e58-d5dfb68fe94b service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:45.369117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:45.371137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:45.371893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:45.372508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:45.390824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:45.394985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:45.412624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1144/2274] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:44:45.425238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:45.428342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:45.453853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1131/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:51.308268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:51.310342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:51.408618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:51.432113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6740d4-e1ac-45a3-bba1-4e298d617d9f service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:51.437425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:51.438140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:51.438504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:51.438809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:51.441229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:51.455238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:51.456864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:51.467723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1145/2276] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:51.499719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:51.511483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:51.528523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771049-0769-4878-9ce3-20f2b15976a5 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:51.534507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:51.535199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:51.535697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:51.536130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] PATH_INFO: `/v3/users/e9b3debecd8c402a86fb2ad133bdd7d4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:51.538513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b3debecd8c402a86fb2ad133bdd7d4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:51.540765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:51.567113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:51.790792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b3debecd8c402a86fb2ad133bdd7d4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:51.838378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b3debecd8c402a86fb2ad133bdd7d4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:51.839499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b3debecd8c402a86fb2ad133bdd7d4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:51.910843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b3debecd8c402a86fb2ad133bdd7d4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:51.928477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f09d2ecd-00c6-4f42-ab46-b5ec02389d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b3debecd8c402a86fb2ad133bdd7d4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:51.948072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1132/2277] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:44:51 2022] DELETE /identity/v3/users/e9b3debecd8c402a86fb2ad133bdd7d4 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:44:52.453226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:52.468640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121179-8ba4-4adf-b76a-d3ed5d50652b service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:52.560353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:52.561091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:52.561360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:52.561638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] PATH_INFO: `/v3/projects/2b528f2758e246d19953e525d24a29cc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:52.562947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b528f2758e246d19953e525d24a29cc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:52.564992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:52.722371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b528f2758e246d19953e525d24a29cc', 'request_id': 'req-eb89e430-a052-424d-8df1-4beaa09959d0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:52.818067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b528f2758e246d19953e525d24a29cc', 'request_id': 'req-eb89e430-a052-424d-8df1-4beaa09959d0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:52.836328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b528f2758e246d19953e525d24a29cc', 'request_id': 'req-eb89e430-a052-424d-8df1-4beaa09959d0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:52.852528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] The token cache is being invalidate because project 2b528f2758e246d19953e525d24a29cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:44:52.852876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:52.853696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb89e430-a052-424d-8df1-4beaa09959d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:52.857025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1146/2278] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:44:52 2022] DELETE /identity/v3/projects/2b528f2758e246d19953e525d24a29cc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:44:52.862968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:52.863833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:52.863989 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:52.887663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:52.896935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:52.979172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1133/2279] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:52.982881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:52.983382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:52.983862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.020001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:53.023060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:53.043988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1147/2280] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:53.047991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.059352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102e3b3-1a4a-4e5e-aeb9-b286cee88671 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.067414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.068063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.068346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.068620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.069295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:44:53.069851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.071779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.087008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1134/2281] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:44:53.098135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.116659 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3546f3f-d783-43e2-89d1-eadf871f51ab None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.128453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.129625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.133888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.133888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.133888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.135906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.223466 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.227044 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:53.357123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11ea61-f568-411a-8a4d-03c92669ef6a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.362849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.363756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.364036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.364307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.366172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:53.371418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1148/2282] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:44:53 2022] POST /identity/v3/projects => generated 371 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:44:53.377821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.379242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.381483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.397893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1135/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:53.465246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:53.489176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a614c-74eb-4e65-a5bd-a52b4b3213e7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.492321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.492927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.493299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.493749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.494534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.498042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.743381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1149/2284] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:44:53 2022] POST /identity/v3/users => generated 286 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:44:53.745564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.764907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5bdcf-294d-4862-ad9f-5dc596bb5459 service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.772550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.773501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.773946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.774375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.775290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.777665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.790485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1136/2285] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:44:53.805805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.810638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.813406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:53.834051 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc9bd-9432-4f47-b02e-ed77421a8466 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.834715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:53.844295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.845652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.846685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.847258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.848625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.852670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.882040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1150/2286] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:44:53.882427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:53.906294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d002d96-afa1-4cb8-9d96-ee1ae90bd418 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.919810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.920424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.920703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.920981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] PATH_INFO: `/v3/projects/61e1a4d7389d42efac66b24c8086a137/users/8da462f012bf4a0bbba9034c19fefb99/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.959217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e1a4d7389d42efac66b24c8086a137, user_id=8da462f012bf4a0bbba9034c19fefb99, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:53.960752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4bde8-f21c-4c1c-b5e6-b8f0ad9bcc4d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:53.968391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:53.968939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:53.969995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:53.970967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:53.972122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:53.975881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:54.002743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:54.006109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3963cd5-4274-40e4-b870-9e98384b7c12 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:54.032098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1137/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:44:54.071147 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1151/2288] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:44:53 2022] PUT /identity/v3/projects/61e1a4d7389d42efac66b24c8086a137/users/8da462f012bf4a0bbba9034c19fefb99/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:44:54.088165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:54.089012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:54.090363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:54.141424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] MFA Rules not processed for user `8da462f012bf4a0bbba9034c19fefb99`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:54.143912 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:54.257087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1138/2289] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:54.277353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:54.280347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:54.381154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492826cf-66bd-45a9-ad34-c737921bc95e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:54.394510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:54.394510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:54.394510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:54.394510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:54.405642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:54.407797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:54.423379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1152/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:56.924719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:56.929156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:57.026310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400ef5-429c-4c3b-8ffd-e46de9551ec4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:57.054821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:57.058304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:57.059128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:57.059816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:57.067654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:57.244544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:57.249850 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:57.289595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1139/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:58.039667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:58.057609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad322a-3860-44cb-ab04-d46a0009f33b service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:58.073657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:58.075014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:58.075335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:58.075572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:58.077675 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:58.092930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:58.094664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fca8ce-e251-40c6-a7d8-cfd7446ddf71 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:58.112837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1153/2292] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:58.941568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:59.055793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:59.095505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab030e-eafb-4777-b619-57ce66a2540e service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:59.101189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:59.102023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:59.102407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:59.102943 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] PATH_INFO: `/v3/users/8da462f012bf4a0bbba9034c19fefb99` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:59.104326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da462f012bf4a0bbba9034c19fefb99)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:59.107169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:59.506235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da462f012bf4a0bbba9034c19fefb99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:59.550100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da462f012bf4a0bbba9034c19fefb99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:59.551406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da462f012bf4a0bbba9034c19fefb99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:59.714910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da462f012bf4a0bbba9034c19fefb99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:59.727764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da462f012bf4a0bbba9034c19fefb99'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:44:59.749592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1140/2293] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:44:58 2022] DELETE /identity/v3/users/8da462f012bf4a0bbba9034c19fefb99 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:44:59.756067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:59.757798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:59.758525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:59.798541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:59.800078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:00.012759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1154/2294] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:00.032334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:00.035916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:00.174956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89a890-1e94-4990-9c1d-0f796565c959 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:00.190140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:00.192115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:00.192849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:00.193547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:00.219845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:00.223514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:00.284165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1141/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:00.838096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:00.842598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:00.876596 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:00.877185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f54ccf-5e90-4aec-ab7e-e66c873fa5b2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:00.879186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:00.883598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:00.884388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:00.884737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:00.885080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] PATH_INFO: `/v3/users/0b8cfe691e0848d880fb4d88e15f9abd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:00.888268 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8cfe691e0848d880fb4d88e15f9abd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:00.892151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:00.907102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc38ea2-b723-4bb6-b6ff-65eea9ec50dd service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:00.914732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:00.920870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:00.921869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:00.922371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:00.922936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] PATH_INFO: `/v3/projects/61e1a4d7389d42efac66b24c8086a137` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:00.925007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e1a4d7389d42efac66b24c8086a137)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:00.928125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:01.227085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8cfe691e0848d880fb4d88e15f9abd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.227344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e1a4d7389d42efac66b24c8086a137', 'request_id': 'req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.228628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8cfe691e0848d880fb4d88e15f9abd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.232447 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:01.242900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8cfe691e0848d880fb4d88e15f9abd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.359236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e1a4d7389d42efac66b24c8086a137', 'request_id': 'req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.368363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e1a4d7389d42efac66b24c8086a137', 'request_id': 'req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.379310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] The token cache is being invalidate because project 61e1a4d7389d42efac66b24c8086a137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:01.379602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.380315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-254b3bd1-61a1-4fe9-88ad-0f2ff6aa0a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.381866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1142/2296] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:00 2022] DELETE /identity/v3/projects/61e1a4d7389d42efac66b24c8086a137 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:01.387415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.387706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.387981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.409216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:01.410461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:01.435181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8cfe691e0848d880fb4d88e15f9abd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.435990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-88cb5536-439b-4d41-a1a6-a30269f4378a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8cfe691e0848d880fb4d88e15f9abd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:01.452043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1155/2297] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:00 2022] DELETE /identity/v3/users/0b8cfe691e0848d880fb4d88e15f9abd => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:01.477504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1143/2298] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:01.487505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.488041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.488470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.513396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:01.514592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:01.604916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1156/2299] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:01.611218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:01.626002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d197-4aa1-43a8-8193-307c870ef778 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:01.632644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:01.633693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.634898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.634898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.635515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:01.636012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:01.640491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:01.659812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1144/2300] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:01.667598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:01.678947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75077a7-f013-45dd-bba6-cb65fa048919 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:01.685316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:01.686251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.686645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.687098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.687920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:01.690760 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:01.804224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:01.806315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:01.828769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955beb-2790-46c1-a198-390429db15d0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:01.836264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:01.837168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.837658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.838166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] PATH_INFO: `/v3/projects/8ab718c19e5f4ae6a7af4dc6f2ba709a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.840709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab718c19e5f4ae6a7af4dc6f2ba709a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:01.842107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1157/2301] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:01 2022] POST /identity/v3/projects => generated 393 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:01.843192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:01.847833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:01.936357 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e238ee-a743-4bcf-9442-52539527c6b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:01.941160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:01.941839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.942146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.943332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.943996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:01.946029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:01.957886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:01.969577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab718c19e5f4ae6a7af4dc6f2ba709a', 'request_id': 'req-1963448c-7cac-4b76-8444-ef486e843055'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.056686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1158/2302] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:01 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:02.062501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:02.075506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dd3c4-4b1c-4987-95db-8afede6a501b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:02.084649 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab718c19e5f4ae6a7af4dc6f2ba709a', 'request_id': 'req-1963448c-7cac-4b76-8444-ef486e843055'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.093147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab718c19e5f4ae6a7af4dc6f2ba709a', 'request_id': 'req-1963448c-7cac-4b76-8444-ef486e843055'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.127926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] The token cache is being invalidate because project 8ab718c19e5f4ae6a7af4dc6f2ba709a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:02.128736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.130216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.135386 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1145/2303] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:01 2022] DELETE /identity/v3/projects/8ab718c19e5f4ae6a7af4dc6f2ba709a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:02.140583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:02.143343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:02.196368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:02.197371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.197859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.198347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.200795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:02.203838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:02.222769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1159/2304] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:02.227121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:02.230521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:02.257797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89a1f7-ac47-481f-b987-d037f0dd05a9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:02.268791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:02.272626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:02.274171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.274808 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.275428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.277220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:02.280225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:02.296744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963448c-7cac-4b76-8444-ef486e843055 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:02.297136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1160/2305] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:45:02.297803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:02.305252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:02.309140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.309140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.309140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] PATH_INFO: `/v3/users/71f9afaced7a427885bd61aa8222f819` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.309896 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ecf5-3a0d-474d-930d-ac4bfad6868d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:02.310538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f9afaced7a427885bd61aa8222f819)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:02.313470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:02.317833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740cfa1-0deb-4ddc-b663-61f003a41e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:02.318515 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740cfa1-0deb-4ddc-b663-61f003a41e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.318924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740cfa1-0deb-4ddc-b663-61f003a41e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.319205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740cfa1-0deb-4ddc-b663-61f003a41e40 admin admin] PATH_INFO: `/v3/projects/904adbc686ad460a983d09648c6e2e0f/users/8456a3e67ba440638f58986a3b2a5646/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.340066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740cfa1-0deb-4ddc-b663-61f003a41e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904adbc686ad460a983d09648c6e2e0f, user_id=8456a3e67ba440638f58986a3b2a5646, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:02.342803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740cfa1-0deb-4ddc-b663-61f003a41e40 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:02.444841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1161/2306] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:02 2022] PUT /identity/v3/projects/904adbc686ad460a983d09648c6e2e0f/users/8456a3e67ba440638f58986a3b2a5646/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:02.467393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.467928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.468461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.505391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] MFA Rules not processed for user `8456a3e67ba440638f58986a3b2a5646`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:02.506657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:02.587526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f9afaced7a427885bd61aa8222f819'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.597027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1162/2307] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:02.603032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:02.616693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f9afaced7a427885bd61aa8222f819'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.617938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f9afaced7a427885bd61aa8222f819'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.696382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdc5e7-1219-4608-be24-a12e32335d5d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:02.703059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:02.703788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.704080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.704368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.705042 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:02.707521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:02.709617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f9afaced7a427885bd61aa8222f819'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.722814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f9afaced7a427885bd61aa8222f819'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:02.734235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1146/2308] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:02 2022] DELETE /identity/v3/users/71f9afaced7a427885bd61aa8222f819 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:03.046711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1163/2309] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:02 2022] POST /identity/v3/projects => generated 393 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:03.051009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.052554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:03.092997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.095936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:03.140111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486cf3-c61c-417a-9d9e-68b58f3516cc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:03.191347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed7dbf-2eb1-48a7-b755-0f3bd16857e4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:03.196608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:03.199276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:03.199276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:03.199276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] PATH_INFO: `/v3/projects/5663710299e747dda09b21d027dff0e6` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:03.199276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5663710299e747dda09b21d027dff0e6)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:03.201178 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:03.250946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6895b-51d2-4039-b12f-81cb0961b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:03.252012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6895b-51d2-4039-b12f-81cb0961b1de admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:03.252012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6895b-51d2-4039-b12f-81cb0961b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:03.252611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6895b-51d2-4039-b12f-81cb0961b1de admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:03.252845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6895b-51d2-4039-b12f-81cb0961b1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:03.254756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6895b-51d2-4039-b12f-81cb0961b1de admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:03.385188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1147/2310] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:03 2022] POST /identity/v3/users => generated 303 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:03.386647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:03.386924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:03.387130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:03.391508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:03.408851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] MFA Rules not processed for user `1e7b37a53a2644c5b4e75c6eb06792a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:03.410549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:03.414449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5663710299e747dda09b21d027dff0e6', 'request_id': 'req-f4e9493f-6f4c-4515-893f-92f2e66df0ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:03.484948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1148/2311] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:03.486059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.561731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6946af9-6a99-4060-bd78-297c48aaa7aa None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:03.568242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:03.569272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:03.569272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:03.569664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:03.570655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:03.572693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:03.572981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5663710299e747dda09b21d027dff0e6', 'request_id': 'req-f4e9493f-6f4c-4515-893f-92f2e66df0ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:03.585592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1149/2312] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:03.595046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5663710299e747dda09b21d027dff0e6', 'request_id': 'req-f4e9493f-6f4c-4515-893f-92f2e66df0ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:03.596083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.609038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] The token cache is being invalidate because project 5663710299e747dda09b21d027dff0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:03.609421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:03.610377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:03.622746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4e79-8ee3-420f-b075-c0e501855b84 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:03.623021 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1164/2313] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:03 2022] DELETE /identity/v3/projects/5663710299e747dda09b21d027dff0e6 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:03.623206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:03.623206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:03.623206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:03.623206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] PATH_INFO: `/v3/projects/8647392a9b904c1da7d0b0eaca96a9a1/users/1c72b54fdf0a4fc49f25f84863d158b0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:03.639520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8647392a9b904c1da7d0b0eaca96a9a1, user_id=1c72b54fdf0a4fc49f25f84863d158b0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:03.643110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:03.722724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:03.775111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1150/2314] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:03 2022] PUT /identity/v3/projects/8647392a9b904c1da7d0b0eaca96a9a1/users/1c72b54fdf0a4fc49f25f84863d158b0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:03.781867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.783900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:03.810140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9493f-6f4c-4515-893f-92f2e66df0ad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:03.942358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:03.943451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:03.951349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:03.951349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:03.951349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:03.951349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:03.961888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.964009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:03.968762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1165/2315] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:03.975163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:03.993627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c5ca-96bc-4451-b21d-d35b33f11b32 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:04.002685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3a1ef-3555-4238-b18f-2e6af632b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:04.003806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3a1ef-3555-4238-b18f-2e6af632b1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:04.004299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3a1ef-3555-4238-b18f-2e6af632b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:04.004800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3a1ef-3555-4238-b18f-2e6af632b1a0 admin admin] PATH_INFO: `/v3/projects/8647392a9b904c1da7d0b0eaca96a9a1/users/1c72b54fdf0a4fc49f25f84863d158b0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:04.008364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3a1ef-3555-4238-b18f-2e6af632b1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8647392a9b904c1da7d0b0eaca96a9a1, user_id=1c72b54fdf0a4fc49f25f84863d158b0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:04.014809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3a1ef-3555-4238-b18f-2e6af632b1a0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:04.024493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:04.040373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1166/2316] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:03 2022] PUT /identity/v3/projects/8647392a9b904c1da7d0b0eaca96a9a1/users/1c72b54fdf0a4fc49f25f84863d158b0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:04.046545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19d785-30c6-444a-80c7-c0a3a8a715d6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:04.059845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:04.060506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:04.060652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:04.097044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] MFA Rules not processed for user `1c72b54fdf0a4fc49f25f84863d158b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:04.098322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.126310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:04.127458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:04.127968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:04.128481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:04.131535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.149384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:04.152812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:04.166414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1151/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:04.196427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1167/2318] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:04.210153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:04.212201 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.298146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96084220-6d12-46df-9c71-6afe8ffd3878 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:04.302210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:04.302888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:04.303170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:04.303444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:04.315314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:04.317016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:04.329827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1152/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:04.355004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:04.383805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:04.385482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.400802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e305a-0c4c-422e-a79a-b58f35e84a86 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:04.405573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:04.406213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:04.406542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:04.406793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:04.408986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.519594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:04.522160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:04.539972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1168/2320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:04.698493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:04.702552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.843835 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6f22-133c-4521-b5a0-6e84534cdeb2 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:04.850918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:04.853350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:04.853350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:04.853350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:04.854415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:04.872117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:04.873819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c30da-d4bb-4c8e-9368-76eb558a579b service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:04.886173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1153/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:10.451827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:10.530319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc701-c5c3-477e-9681-7dc41038f9df service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:10.535260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:10.536122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:10.536293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:10.536454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] PATH_INFO: `/v3/users/8456a3e67ba440638f58986a3b2a5646` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:10.537739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8456a3e67ba440638f58986a3b2a5646)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:10.539807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:10.549914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:10.794012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8456a3e67ba440638f58986a3b2a5646'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:10.795055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8456a3e67ba440638f58986a3b2a5646'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:10.818526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8456a3e67ba440638f58986a3b2a5646'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:10.927369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8456a3e67ba440638f58986a3b2a5646'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:10.928536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8456a3e67ba440638f58986a3b2a5646'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:10.947044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1169/2322] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:10 2022] DELETE /identity/v3/users/8456a3e67ba440638f58986a3b2a5646 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:10.952841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:10.953430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:10.953573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:10.975063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:10.976412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:11.068295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1154/2323] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:11.082139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:11.083961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:11.165139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a0a5-4e73-4a19-a06d-4afc115f3c98 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:11.170555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:11.171353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:11.171722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:11.172096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:11.186371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:11.187900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:11.199962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1170/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:11.821293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:11.822987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:11.842345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801c7c-758b-4d19-82c6-c89edb77afb9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:11.853633 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:11.854942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:11.855556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:11.856318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] PATH_INFO: `/v3/projects/904adbc686ad460a983d09648c6e2e0f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:11.859048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=904adbc686ad460a983d09648c6e2e0f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:11.863451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:11.882999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:12.001919 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904adbc686ad460a983d09648c6e2e0f', 'request_id': 'req-9044ea72-2914-4df1-b6c2-d13e5be62a00'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.103877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904adbc686ad460a983d09648c6e2e0f', 'request_id': 'req-9044ea72-2914-4df1-b6c2-d13e5be62a00'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.112332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904adbc686ad460a983d09648c6e2e0f', 'request_id': 'req-9044ea72-2914-4df1-b6c2-d13e5be62a00'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.135947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] The token cache is being invalidate because project 904adbc686ad460a983d09648c6e2e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:12.136921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.137574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.139261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1155/2325] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:11 2022] DELETE /identity/v3/projects/904adbc686ad460a983d09648c6e2e0f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:12.144105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:12.156084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3851bfc-27ae-4824-93ad-a92dee4a89ce service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:12.228073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:12.228724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:12.228999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:12.229273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] PATH_INFO: `/v3/users/1c72b54fdf0a4fc49f25f84863d158b0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:12.231151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c72b54fdf0a4fc49f25f84863d158b0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:12.233537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:12.504217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:12.519248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c72b54fdf0a4fc49f25f84863d158b0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.519906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c72b54fdf0a4fc49f25f84863d158b0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.533045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c72b54fdf0a4fc49f25f84863d158b0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.640594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c72b54fdf0a4fc49f25f84863d158b0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.641279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f203e34-fdce-4a39-9978-62eb22200e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c72b54fdf0a4fc49f25f84863d158b0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:12.657155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1171/2326] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:12 2022] DELETE /identity/v3/users/1c72b54fdf0a4fc49f25f84863d158b0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:13.367862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:13.374177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:13.398842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ea72-2914-4df1-b6c2-d13e5be62a00 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:13.517439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:13.519032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:13.519958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:13.519958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] PATH_INFO: `/v3/projects/8647392a9b904c1da7d0b0eaca96a9a1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:13.522670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8647392a9b904c1da7d0b0eaca96a9a1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:13.526498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:13.635187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8647392a9b904c1da7d0b0eaca96a9a1', 'request_id': 'req-ed230d21-ab47-4f09-a173-b4bf34e39622'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:13.714963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8647392a9b904c1da7d0b0eaca96a9a1', 'request_id': 'req-ed230d21-ab47-4f09-a173-b4bf34e39622'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:13.721868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8647392a9b904c1da7d0b0eaca96a9a1', 'request_id': 'req-ed230d21-ab47-4f09-a173-b4bf34e39622'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:13.734821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] The token cache is being invalidate because project 8647392a9b904c1da7d0b0eaca96a9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:13.735660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:13.735923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ed230d21-ab47-4f09-a173-b4bf34e39622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:13.737392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1156/2327] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:13 2022] DELETE /identity/v3/projects/8647392a9b904c1da7d0b0eaca96a9a1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:13.747391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:13.748900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:13.749403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:13.784975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:13.786586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:13.897978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1172/2328] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:13.909918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:13.910199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:13.910472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:13.935358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:13.937508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:13.955970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1157/2329] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:13.957304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:13.968736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa008bce-c779-4bea-84ac-70ef6c83695f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:13.974006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:13.974750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:13.975036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:13.975310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:13.976001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:13.976310 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:13.977994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:13.996709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1173/2330] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:13.998303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:14.009119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce886813-9ec1-4975-90c9-14d36e59b01f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:14.014244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:14.020784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.020784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.020784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.020784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:14.020784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:14.159126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1158/2331] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:13 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:14.163518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:14.178257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50869e-61e6-49af-a633-d6daedfa9f92 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:14.257270 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:14.257890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.258169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.258525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.259199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:14.261194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:14.427646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1174/2332] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:14 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:14.427951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:14.427951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:14.438831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0094de8-9a7b-4d5a-99b9-729c64e34d44 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:14.450454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:14.451783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.452549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.453570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.455192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:14.459046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:14.487548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1159/2333] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:14.489788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:14.507447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc378852-2d1f-4cf0-adbc-13ac85ee719d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:14.515907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd6339-0cb4-4318-9458-07af6b070eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:14.516937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd6339-0cb4-4318-9458-07af6b070eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.517439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd6339-0cb4-4318-9458-07af6b070eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.518209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd6339-0cb4-4318-9458-07af6b070eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.519465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd6339-0cb4-4318-9458-07af6b070eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:14.522703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd6339-0cb4-4318-9458-07af6b070eb6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:14.543223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1175/2334] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:14.550358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:14.568645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b5ef2-fb2b-4bd3-b369-1fc68b2296dc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:14.578100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:14.579219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.579709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.580182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] PATH_INFO: `/v3/projects/131ab9aa4cbd4ba58c2765f3558658c0/users/0812eeac030c400f82a74bce5fc2998b/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.615280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131ab9aa4cbd4ba58c2765f3558658c0, user_id=0812eeac030c400f82a74bce5fc2998b, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:14.619192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:14.714141 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1160/2335] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:14 2022] PUT /identity/v3/projects/131ab9aa4cbd4ba58c2765f3558658c0/users/0812eeac030c400f82a74bce5fc2998b/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:14.727475 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.728280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.728504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.757793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:14.761748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] MFA Rules not processed for user `0812eeac030c400f82a74bce5fc2998b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:14.762963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:14.859393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1176/2336] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:14.864166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:14.933322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5380d-121b-4c88-946b-ae7d973a8cc7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:14.938260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:14.938961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:14.939193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:14.939465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:14.940096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:14.941983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.043178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1161/2337] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:14 2022] POST /identity/v3/projects => generated 401 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:15.049343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:15.066638 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550b716-c94a-4302-8d41-ea92afa372b1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:15.130252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:15.130916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.131198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.131478 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.132120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:15.134092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.245672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1177/2338] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:15 2022] POST /identity/v3/users => generated 307 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:15.250022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:15.260890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c4e0e-c59f-47ed-b45d-c679d49bd392 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:15.266599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:15.267256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.267537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.268153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.268891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:15.270540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.283734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1162/2339] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:15.288572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:15.300089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c18d-d7f6-452e-9a08-9b2c58f74540 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:15.304960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:15.305688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.305966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.306241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] PATH_INFO: `/v3/projects/a767598e8cbc401aa66dcb6f6ef4b136/users/af515972320244d58073c6c75dd09518/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.324519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767598e8cbc401aa66dcb6f6ef4b136, user_id=af515972320244d58073c6c75dd09518, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:15.327417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.413647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1178/2340] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:15 2022] PUT /identity/v3/projects/a767598e8cbc401aa66dcb6f6ef4b136/users/af515972320244d58073c6c75dd09518/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:15.418503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:15.430571 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049f32-d155-45f5-b087-b5cc7f59673a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:15.514424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb34f-35a2-428b-a66b-e249015056c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:15.515092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb34f-35a2-428b-a66b-e249015056c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.515375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb34f-35a2-428b-a66b-e249015056c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.515648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb34f-35a2-428b-a66b-e249015056c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.516304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbb34f-35a2-428b-a66b-e249015056c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:15.518635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbb34f-35a2-428b-a66b-e249015056c1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.530236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1163/2341] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:15.535043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:15.547287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3317-6263-4a2d-aaef-58dacb7b786e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:15.552117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:15.552779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.553186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.553466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] PATH_INFO: `/v3/projects/a767598e8cbc401aa66dcb6f6ef4b136/users/af515972320244d58073c6c75dd09518/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.555444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767598e8cbc401aa66dcb6f6ef4b136, user_id=af515972320244d58073c6c75dd09518, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:15.558851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.575767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1179/2342] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:15 2022] PUT /identity/v3/projects/a767598e8cbc401aa66dcb6f6ef4b136/users/af515972320244d58073c6c75dd09518/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:15.593710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.594008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.594286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.626939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] MFA Rules not processed for user `af515972320244d58073c6c75dd09518`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:15.628157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:15.660126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:15.709636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1164/2343] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:15 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:15.717149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:15.719089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:15.791956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176a203-1b88-49d7-a2df-884792934f27 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:15.796193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:15.796903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.797182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.797455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.814750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:15.816382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:15.821128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:15.829785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1180/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:16.055833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:16.057626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:16.136288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceca86f-3028-4642-8391-64ff42af17ef None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:16.142460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:16.143461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:16.143819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:16.144167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:16.146042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:16.148381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:16.158460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e53814-ba65-4f0a-a1d0-227f0f935339 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:16.163576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:16.164695 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:16.164851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:16.166654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:16.166654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:16.168058 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f480b7-46d9-4939-93f6-3060f9d524a2 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:16.188173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1165/2345] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:16.251008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:16.252603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:16.263069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1181/2346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:16 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:20.123953 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:20.130211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:20.130211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:20.172553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:20.172553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:20.296115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1166/2347] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:20.314635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:20.316768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:20.408557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a919-f84c-4f8c-98da-ff6688229c55 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:20.416578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:20.417727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:20.418336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:20.419720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:20.432076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:20.433902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:20.443380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1182/2348] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:45:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:45:21.462024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:21.479021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e9e38-4320-4782-87ba-575dfaab9884 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:21.487848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:21.497449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:21.499373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:21.499373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:21.500764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:21.517278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:21.519361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ef66e-f802-464e-b7ac-3aa101be2033 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:21.538068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1167/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:22.055916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:22.192558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de506ea-c8ad-4c5b-92de-d243146144b1 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:22.207496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:22.208210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:22.208481 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:22.209915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] PATH_INFO: `/v3/users/0812eeac030c400f82a74bce5fc2998b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:22.212348 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=0812eeac030c400f82a74bce5fc2998b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:22.214765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:22.361967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:22.512185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0812eeac030c400f82a74bce5fc2998b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:22.513082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0812eeac030c400f82a74bce5fc2998b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:22.551390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0812eeac030c400f82a74bce5fc2998b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:22.699418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0812eeac030c400f82a74bce5fc2998b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:22.700288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0812eeac030c400f82a74bce5fc2998b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:22.748466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1183/2350] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:22 2022] DELETE /identity/v3/users/0812eeac030c400f82a74bce5fc2998b => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:22.756771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:22.757475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:22.757475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:22.787132 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:22.793852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:22.847884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:22.908261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1168/2351] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:22.920084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:22.925582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:23.067855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058fd55-7bff-40b1-8bc8-edbec0bc8ced admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:23.079243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:23.080325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:23.080718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:23.081095 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:23.094262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:23.096146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:23.114568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1184/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:23.721527 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:23.722301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:23.768454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333d37-2c86-4344-988d-193f603d9b56 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:23.781678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:23.782350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:23.782630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:23.782955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] PATH_INFO: `/v3/projects/131ab9aa4cbd4ba58c2765f3558658c0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:23.784168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=131ab9aa4cbd4ba58c2765f3558658c0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:23.786119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:23.937833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131ab9aa4cbd4ba58c2765f3558658c0', 'request_id': 'req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:24.024210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131ab9aa4cbd4ba58c2765f3558658c0', 'request_id': 'req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:24.039743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131ab9aa4cbd4ba58c2765f3558658c0', 'request_id': 'req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:24.063142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] The token cache is being invalidate because project 131ab9aa4cbd4ba58c2765f3558658c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:24.063604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:24.064728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:24.067973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1169/2353] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:23 2022] DELETE /identity/v3/projects/131ab9aa4cbd4ba58c2765f3558658c0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:24.072030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:24.092780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3752d-e3d3-425f-8d85-a4661f63c192 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:24.217717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:24.218739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:24.218968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:24.219329 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] PATH_INFO: `/v3/users/af515972320244d58073c6c75dd09518` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:24.221598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af515972320244d58073c6c75dd09518)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:24.224413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:25.113028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af515972320244d58073c6c75dd09518'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:25.114621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af515972320244d58073c6c75dd09518'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:25.117182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:25.130535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af515972320244d58073c6c75dd09518'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:25.259686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af515972320244d58073c6c75dd09518'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:25.261104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-14f60ac8-7770-49f9-b515-6b18eb952f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af515972320244d58073c6c75dd09518'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:25.287694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1185/2354] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:24 2022] DELETE /identity/v3/users/af515972320244d58073c6c75dd09518 => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:25.869610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:25.872392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:25.905251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9006-f2b0-4947-a3b7-ad0479415c5b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:26.002677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:26.004427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.004718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.005083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] PATH_INFO: `/v3/projects/a767598e8cbc401aa66dcb6f6ef4b136` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.006484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a767598e8cbc401aa66dcb6f6ef4b136)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:26.008495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:26.172076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a767598e8cbc401aa66dcb6f6ef4b136', 'request_id': 'req-1ada0a71-7e4c-496d-b763-c27b6de80905'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:26.275410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a767598e8cbc401aa66dcb6f6ef4b136', 'request_id': 'req-1ada0a71-7e4c-496d-b763-c27b6de80905'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:26.285464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a767598e8cbc401aa66dcb6f6ef4b136', 'request_id': 'req-1ada0a71-7e4c-496d-b763-c27b6de80905'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:26.290798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:26.301945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] The token cache is being invalidate because project a767598e8cbc401aa66dcb6f6ef4b136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:26.302473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:26.304831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ada0a71-7e4c-496d-b763-c27b6de80905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:26.305273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1170/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:25 2022] DELETE /identity/v3/projects/a767598e8cbc401aa66dcb6f6ef4b136 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:26.311237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.312210 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.312676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.357005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:26.359362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:26.498307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1186/2356] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:26.507851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.508977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.509748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.570864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:26.573937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:26.609184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1171/2357] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:26.610527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:26.626948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4462d75-1edc-4543-9cc2-dd9742cf1e83 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:26.632545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:26.633981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.634461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.634945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.636419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:26.636725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:26.638879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:26.658726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1187/2358] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:26.678262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:26.712506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3ff9d-1e57-4662-8fc6-b460ec7b02c3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:26.719550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:26.720107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.720537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.720811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.721606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:26.724131 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:26.860874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1172/2359] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:26 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:26.866231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:26.879597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfdb9d-4544-4ad2-b766-fc2742b84ebf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:26.965881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:26.966551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.966871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.967142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.967795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:26.970055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:27.071256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1188/2360] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:26 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:27.076394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:27.088113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc96ee-0da0-479c-a4ef-0965c73cee4b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:27.094194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:27.094853 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:27.095135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:27.095540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:27.096102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:27.097722 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:27.114383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1173/2361] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:27.118919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:27.146259 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d829-c05d-4c3b-baf3-03c35af95cde admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:27.153831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270802f-3c0a-4d8a-a2df-289c8b0dc3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:27.155102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270802f-3c0a-4d8a-a2df-289c8b0dc3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:27.155673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270802f-3c0a-4d8a-a2df-289c8b0dc3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:27.156237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270802f-3c0a-4d8a-a2df-289c8b0dc3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:27.157601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270802f-3c0a-4d8a-a2df-289c8b0dc3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:27.160900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270802f-3c0a-4d8a-a2df-289c8b0dc3f7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:27.185873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1189/2362] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:45:27.187643 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:27.203240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790609b-fba1-43b4-86f3-fb6bc0101eca admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:27.214218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:27.214975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:27.215269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:27.215681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] PATH_INFO: `/v3/projects/176f88e36d9b487a9766d91fee0d4ead/users/46d56100404a4fdfbb4f8e957c003ead/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:27.241462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176f88e36d9b487a9766d91fee0d4ead, user_id=46d56100404a4fdfbb4f8e957c003ead, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:27.244411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:27.348262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1174/2363] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:27 2022] PUT /identity/v3/projects/176f88e36d9b487a9766d91fee0d4ead/users/46d56100404a4fdfbb4f8e957c003ead/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:27.356677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:27.357569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:27.357717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:27.400077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] MFA Rules not processed for user `46d56100404a4fdfbb4f8e957c003ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:27.401927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:27.437987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:27.502067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1190/2364] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:27.506875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:27.637392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e69c-fd8c-4f78-b2eb-07e459006d52 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:27.648366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:27.649914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:27.650705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:27.651223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:27.652703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:27.658280 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:27.784510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1175/2365] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:27 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:27.789934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:27.809951 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e853c3-5997-4f73-9a27-0ef54edf3700 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:27.992612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:27.993255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:27.993548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:27.993845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:27.994457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:27.997167 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:28.102041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1191/2366] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:27 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:28.108929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:28.132219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8224f90-a03c-4ccd-a135-d698ea2ba027 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:28.144990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:28.146149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.146540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.146941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.148250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:28.152994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:28.172992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1176/2367] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:28.177924 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:28.194155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fdeb4-1381-445c-8623-81fbe4bb7485 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:28.200940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e378-a181-4bb1-8be8-7dae5174f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:28.201891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e378-a181-4bb1-8be8-7dae5174f464 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.202274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e378-a181-4bb1-8be8-7dae5174f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.202660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e378-a181-4bb1-8be8-7dae5174f464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.203631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e378-a181-4bb1-8be8-7dae5174f464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:28.205758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e378-a181-4bb1-8be8-7dae5174f464 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:28.223448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1192/2368] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:28.229027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:28.245239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110364e-1c7e-4320-83a2-064862891330 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:28.255085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:28.255085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.255085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.255085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] PATH_INFO: `/v3/projects/a8ecca332b88439493e22165c38595e8/users/1ce3a9e8c93c45139c59c849379db781/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.273422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ecca332b88439493e22165c38595e8, user_id=1ce3a9e8c93c45139c59c849379db781, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:28.278048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:28.499740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1177/2369] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:28 2022] PUT /identity/v3/projects/a8ecca332b88439493e22165c38595e8/users/1ce3a9e8c93c45139c59c849379db781/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:28.513008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.523996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.523996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.551945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] MFA Rules not processed for user `1ce3a9e8c93c45139c59c849379db781`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:28.553201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:28.637594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1193/2370] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:28.640535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:28.689726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:28.707748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f72747-6133-4917-86cb-38ab45240efe admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:28.716651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:28.717272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.717552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.717828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.721257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:28.721257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:28.903676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1178/2371] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:28 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:28.908166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:28.920080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81606859-389f-401c-91f1-73e2fcaef7c4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:28.955845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:28.989522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:28.989994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.990281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.990560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.991260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:28.993317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.092658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1194/2372] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:28 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:29.099468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:29.121661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e6c8-2b82-424f-94d9-d53e35797a63 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:29.136152 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:29.137301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.137752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.138274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.142268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:29.146256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.176669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1179/2373] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:29.178120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:29.195656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6c609-bc99-47a8-9e5a-c61fb3fca3e2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:29.204882 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:29.205761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.212648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.212648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] PATH_INFO: `/v3/projects/dedbf08aabe84f29ba83f92592fa48c8/users/f787e19fd7ee448eaccaa0a8ce8506d8/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.227779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedbf08aabe84f29ba83f92592fa48c8, user_id=f787e19fd7ee448eaccaa0a8ce8506d8, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:29.231984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.349413 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1195/2374] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:29 2022] PUT /identity/v3/projects/dedbf08aabe84f29ba83f92592fa48c8/users/f787e19fd7ee448eaccaa0a8ce8506d8/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:29.352192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:29.378798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747d40-606c-463e-8539-17a7cc79f12c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:29.494779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab08c07-1e40-4c4d-a1b5-5e5cbed96aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:29.495879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08c07-1e40-4c4d-a1b5-5e5cbed96aef admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.496166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08c07-1e40-4c4d-a1b5-5e5cbed96aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.496452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08c07-1e40-4c4d-a1b5-5e5cbed96aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.497262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab08c07-1e40-4c4d-a1b5-5e5cbed96aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:29.499128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab08c07-1e40-4c4d-a1b5-5e5cbed96aef admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.511180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1180/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:29.515912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:29.530374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83e54-2324-462c-8d58-3948259d9653 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:29.537065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:29.538391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.538678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.539054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] PATH_INFO: `/v3/projects/dedbf08aabe84f29ba83f92592fa48c8/users/f787e19fd7ee448eaccaa0a8ce8506d8/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.541156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedbf08aabe84f29ba83f92592fa48c8, user_id=f787e19fd7ee448eaccaa0a8ce8506d8, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:29.545153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.561922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1196/2376] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:29 2022] PUT /identity/v3/projects/dedbf08aabe84f29ba83f92592fa48c8/users/f787e19fd7ee448eaccaa0a8ce8506d8/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:29.573952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.574255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.575369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.617061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] MFA Rules not processed for user `f787e19fd7ee448eaccaa0a8ce8506d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:29.619555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:29.753356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1181/2377] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:29.767284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:29.769566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:29.872482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0899b-27c8-43c4-98d9-486428b7734d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:29.879763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:29.882577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.882577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.882577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.906382 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:29.909296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.930402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1197/2378] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:30.065161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:30.066875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:30.086968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03257799-4eb0-47fd-9743-d9b4396a5268 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:30.092558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528980-1be5-4332-9c9e-2aa076a42716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:30.093275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528980-1be5-4332-9c9e-2aa076a42716 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:30.093740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528980-1be5-4332-9c9e-2aa076a42716 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:30.094203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528980-1be5-4332-9c9e-2aa076a42716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:30.134574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:30.174056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58528980-1be5-4332-9c9e-2aa076a42716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:30.176840 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58528980-1be5-4332-9c9e-2aa076a42716 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:30.197111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1182/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:35.063995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:35.160492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457cca-4f8b-455a-b101-9bcfcaec579c service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:35.169133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:35.170102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:35.170525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:35.171061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] PATH_INFO: `/v3/users/46d56100404a4fdfbb4f8e957c003ead` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:35.173409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d56100404a4fdfbb4f8e957c003ead)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:35.177651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:35.328111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:35.505172 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d56100404a4fdfbb4f8e957c003ead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:35.505862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d56100404a4fdfbb4f8e957c003ead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:35.521071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d56100404a4fdfbb4f8e957c003ead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:35.651874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d56100404a4fdfbb4f8e957c003ead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:35.653974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d56100404a4fdfbb4f8e957c003ead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:35.668404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1198/2380] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:35 2022] DELETE /identity/v3/users/46d56100404a4fdfbb4f8e957c003ead => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:35.673540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:35.674084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:35.674205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:35.693988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:35.695176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:35.769839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1183/2381] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:35.780429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:35.781855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:35.860637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdd2d9-9205-4c93-a114-b515d7b58a1e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:35.867071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:35.868111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:35.868600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:35.869082 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:35.885795 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:35.888550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:35.909012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1199/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:36.490495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:36.492283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:36.506893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2be062-dbca-4a89-82d9-ac7e40872fff None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:36.513191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:36.514104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:36.514415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:36.514717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] PATH_INFO: `/v3/projects/176f88e36d9b487a9766d91fee0d4ead` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:36.515961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=176f88e36d9b487a9766d91fee0d4ead)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:36.517936 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:36.703803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176f88e36d9b487a9766d91fee0d4ead', 'request_id': 'req-95cbde64-88e8-4393-a7fa-918dce8ce28d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:36.806063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176f88e36d9b487a9766d91fee0d4ead', 'request_id': 'req-95cbde64-88e8-4393-a7fa-918dce8ce28d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:36.813730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176f88e36d9b487a9766d91fee0d4ead', 'request_id': 'req-95cbde64-88e8-4393-a7fa-918dce8ce28d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:36.830243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] The token cache is being invalidate because project 176f88e36d9b487a9766d91fee0d4ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:36.830536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:36.831334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:36.832958 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1184/2383] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:36 2022] DELETE /identity/v3/projects/176f88e36d9b487a9766d91fee0d4ead => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:36.837746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:36.849709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301b3d-5494-4539-885c-86f01588ba91 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:36.922221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:36.922901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:36.923184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:36.923458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] PATH_INFO: `/v3/users/1ce3a9e8c93c45139c59c849379db781` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:36.924623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce3a9e8c93c45139c59c849379db781)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:36.926564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:37.283929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce3a9e8c93c45139c59c849379db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:37.285240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce3a9e8c93c45139c59c849379db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:37.288069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:37.302870 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce3a9e8c93c45139c59c849379db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:37.468993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce3a9e8c93c45139c59c849379db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:37.469718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce3a9e8c93c45139c59c849379db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:37.487330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1200/2384] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:36 2022] DELETE /identity/v3/users/1ce3a9e8c93c45139c59c849379db781 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:38.015913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:38.015913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:38.030929 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbde64-88e8-4393-a7fa-918dce8ce28d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:38.149952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:38.157634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:38.158410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:38.158848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:38.159260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] PATH_INFO: `/v3/projects/a8ecca332b88439493e22165c38595e8` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:38.160676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ecca332b88439493e22165c38595e8)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:38.162728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:38.351404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ecca332b88439493e22165c38595e8', 'request_id': 'req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.468810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ecca332b88439493e22165c38595e8', 'request_id': 'req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.476395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ecca332b88439493e22165c38595e8', 'request_id': 'req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.489367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] The token cache is being invalidate because project a8ecca332b88439493e22165c38595e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:38.489668 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.490340 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.491993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1185/2385] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:38 2022] DELETE /identity/v3/projects/a8ecca332b88439493e22165c38595e8 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:38.496388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:38.497885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:38.515362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7891-0f15-4e1f-9bde-24bad67b26e7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:38.586564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:38.587249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:38.587527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:38.587801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] PATH_INFO: `/v3/users/f787e19fd7ee448eaccaa0a8ce8506d8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:38.589702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f787e19fd7ee448eaccaa0a8ce8506d8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:38.591866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:38.870104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f787e19fd7ee448eaccaa0a8ce8506d8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.870992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f787e19fd7ee448eaccaa0a8ce8506d8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.884626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f787e19fd7ee448eaccaa0a8ce8506d8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.972050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f787e19fd7ee448eaccaa0a8ce8506d8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.973009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6a8aa84-4e73-48ec-91a9-bd315d4c9931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f787e19fd7ee448eaccaa0a8ce8506d8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:38.992569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1201/2386] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:38 2022] DELETE /identity/v3/users/f787e19fd7ee448eaccaa0a8ce8506d8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:39.636652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:39.638120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:39.662333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1654d2-cc64-4a2c-bb61-1a5e6935d55d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:39.752822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:39.756459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:39.756977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:39.757485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] PATH_INFO: `/v3/projects/dedbf08aabe84f29ba83f92592fa48c8` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:39.762483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedbf08aabe84f29ba83f92592fa48c8)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:39.769061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:39.936331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedbf08aabe84f29ba83f92592fa48c8', 'request_id': 'req-1d1daf1f-b227-4c77-96ba-6cca31e4d739'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:40.034425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedbf08aabe84f29ba83f92592fa48c8', 'request_id': 'req-1d1daf1f-b227-4c77-96ba-6cca31e4d739'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:40.041970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedbf08aabe84f29ba83f92592fa48c8', 'request_id': 'req-1d1daf1f-b227-4c77-96ba-6cca31e4d739'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:40.056652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] The token cache is being invalidate because project dedbf08aabe84f29ba83f92592fa48c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:40.056939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:40.057646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1d1daf1f-b227-4c77-96ba-6cca31e4d739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:40.059331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1186/2387] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:39 2022] DELETE /identity/v3/projects/dedbf08aabe84f29ba83f92592fa48c8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:40.066037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.066815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.066815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.088098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:40.090504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:40.149724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:40.174022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1202/2388] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:40.183941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.184399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.184852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.209964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:40.211263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:40.220268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1187/2389] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:40.224912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.236366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9d56f-0571-4ad2-9f0f-fae61c8f6463 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:40.243759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:40.244749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.245262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.245723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.246897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:40.248854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:40.250486 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:40.270131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1203/2390] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:40.275817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.293113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe6f94-008d-4fc3-995d-0855c1c8820b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:40.301164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:40.302198 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.302717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.303224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.304226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:40.308396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:40.327395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:40.459483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1188/2391] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:40 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:40.465635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.477404 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925b1f-864b-4109-9593-a1668d8403b5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:40.581756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:40.582602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.583052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.583393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.584256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:40.586640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:40.733982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1204/2392] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:40 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:40.738924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.751859 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bbb6-2739-4186-842b-b44d1e74412e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:40.761556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:40.762580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.763145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.763582 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.768443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:40.772140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:40.796360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1189/2393] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:45:40.797880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.809756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec06891-817d-4a84-97ac-c42d97f600e6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:40.814906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd59f7-831a-4c92-86f3-0cc0207ff20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:40.815809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd59f7-831a-4c92-86f3-0cc0207ff20b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.816097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd59f7-831a-4c92-86f3-0cc0207ff20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.820766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd59f7-831a-4c92-86f3-0cc0207ff20b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.820766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd59f7-831a-4c92-86f3-0cc0207ff20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:40.820766 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd59f7-831a-4c92-86f3-0cc0207ff20b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:40.842622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1205/2394] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:40.844185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.856765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242ff4-5681-4a47-939b-7a6a7a3190f8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:40.862973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:40.863842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.864229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.864804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] PATH_INFO: `/v3/projects/1d3cfc93edd343e9b0320a3a20031dad/users/358c325b268a481b8c86b1ab48f762ae/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.888947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3cfc93edd343e9b0320a3a20031dad, user_id=358c325b268a481b8c86b1ab48f762ae, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:40.894855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:41.007783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1190/2395] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:40 2022] PUT /identity/v3/projects/1d3cfc93edd343e9b0320a3a20031dad/users/358c325b268a481b8c86b1ab48f762ae/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:41.022547 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e387-c8f3-4862-8c3e-4553be711cd8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:41.022880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e387-c8f3-4862-8c3e-4553be711cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:41.023250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e387-c8f3-4862-8c3e-4553be711cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:41.059983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5899e387-c8f3-4862-8c3e-4553be711cd8 None None] MFA Rules not processed for user `358c325b268a481b8c86b1ab48f762ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:41.061342 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5899e387-c8f3-4862-8c3e-4553be711cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:41.181985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1206/2396] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:41.198982 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:41.200737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:41.266206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588d003-5f43-47fa-b769-8f40860589eb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:41.270776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c363a0c-1681-4d73-9025-ee74ec41682f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:41.271244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363a0c-1681-4d73-9025-ee74ec41682f service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:41.271677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363a0c-1681-4d73-9025-ee74ec41682f service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:41.271955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363a0c-1681-4d73-9025-ee74ec41682f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:41.281874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c363a0c-1681-4d73-9025-ee74ec41682f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:41.283380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c363a0c-1681-4d73-9025-ee74ec41682f service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:41.294383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1191/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:41.508753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518381f7-4dae-4bc6-9840-cbbf618624e2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:41.509239 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518381f7-4dae-4bc6-9840-cbbf618624e2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:41.509619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518381f7-4dae-4bc6-9840-cbbf618624e2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:41.512037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1207/2398] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:41.521676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc847e7-c44d-46ba-bfbb-e6d29dc085bf None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:41.522018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc847e7-c44d-46ba-bfbb-e6d29dc085bf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:41.527037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc847e7-c44d-46ba-bfbb-e6d29dc085bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:41.555128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8dc847e7-c44d-46ba-bfbb-e6d29dc085bf None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:41.556960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8dc847e7-c44d-46ba-bfbb-e6d29dc085bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:41.664506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1192/2399] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:41.678031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518381f7-4dae-4bc6-9840-cbbf618624e2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:41.680005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-518381f7-4dae-4bc6-9840-cbbf618624e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:41.696935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518381f7-4dae-4bc6-9840-cbbf618624e2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:41.703045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679940-2f66-4cb0-9525-e3241a82756a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:41.703801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679940-2f66-4cb0-9525-e3241a82756a service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:41.704299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679940-2f66-4cb0-9525-e3241a82756a service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:41.704807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679940-2f66-4cb0-9525-e3241a82756a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:41.721287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679940-2f66-4cb0-9525-e3241a82756a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:41.723427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679940-2f66-4cb0-9525-e3241a82756a service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:41.735901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1208/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:42.070605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55a237-af4f-4848-92ff-196e8837b45d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:42.078475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55a237-af4f-4848-92ff-196e8837b45d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:42.078475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55a237-af4f-4848-92ff-196e8837b45d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:42.078475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1193/2401] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:42.082684 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6143616-1121-4a47-8ec1-f38e0ffb6c3d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:42.084255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6143616-1121-4a47-8ec1-f38e0ffb6c3d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:42.084631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6143616-1121-4a47-8ec1-f38e0ffb6c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:42.111750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c6143616-1121-4a47-8ec1-f38e0ffb6c3d None None] MFA Rules not processed for user `73bcaefa6121424bb28c87f8d8729dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:42.113084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6143616-1121-4a47-8ec1-f38e0ffb6c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:42.159981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:42.218280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1209/2402] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:42.232371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55a237-af4f-4848-92ff-196e8837b45d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:42.234163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab55a237-af4f-4848-92ff-196e8837b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:42.249021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55a237-af4f-4848-92ff-196e8837b45d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:42.253077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d18f6-c04b-4565-802c-5873a8160d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:42.253815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d18f6-c04b-4565-802c-5873a8160d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:42.254139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d18f6-c04b-4565-802c-5873a8160d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:42.254487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d18f6-c04b-4565-802c-5873a8160d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:42.263248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d18f6-c04b-4565-802c-5873a8160d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:42.264778 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d18f6-c04b-4565-802c-5873a8160d05 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:42.273986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1194/2403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:42.372267 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1904c-06c5-4a25-beda-61a1b5c9c91e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:42.372743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1904c-06c5-4a25-beda-61a1b5c9c91e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:42.373036 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1904c-06c5-4a25-beda-61a1b5c9c91e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:42.374554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1210/2404] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 05:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:42.381789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e46f-5fe2-4616-b027-5c3421cfee43 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:42.382307 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e46f-5fe2-4616-b027-5c3421cfee43 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:42.382851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e46f-5fe2-4616-b027-5c3421cfee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:42.416388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e1e4e46f-5fe2-4616-b027-5c3421cfee43 None None] MFA Rules not processed for user `5704b06613b94c92896a39fc2b24c280`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:42.418706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e1e4e46f-5fe2-4616-b027-5c3421cfee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:42.435705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1195/2405] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:42.447451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1904c-06c5-4a25-beda-61a1b5c9c91e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:42.450345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-07c1904c-06c5-4a25-beda-61a1b5c9c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:42.465676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1904c-06c5-4a25-beda-61a1b5c9c91e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:42.469476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:42.470130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:42.470407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:42.470735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:42.483071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:42.484647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:42.502637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1211/2406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:47.653572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:47.654446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:47.654446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:47.690640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:47.693040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:47.761931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:47.881238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1196/2407] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 05:45:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:47.938500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:47.950360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:48.099874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17f355-6f5a-4858-8da2-29fa37228e1d service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:48.107237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:48.108307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:48.108307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:48.108534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:48.118003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:48.122569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:48.132628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1212/2408] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:45:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:45:57.967670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=12 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:58.136620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=48 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:58.493995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.496192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:58.513380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609c02f-91b9-4440-95ce-c721664ef4ba None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.520685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.521563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.521848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.522119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.524040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:58.599061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.600727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b22132-b469-45c7-8804-aea996f38eff service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.611888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1197/2409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:59.478536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.550463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de0235-08b1-4bbc-b69d-3eeea37fd1a6 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.555375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.557948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.557948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.557948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] PATH_INFO: `/v3/users/358c325b268a481b8c86b1ab48f762ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.557948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=358c325b268a481b8c86b1ab48f762ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.559955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.793449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358c325b268a481b8c86b1ab48f762ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.794243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358c325b268a481b8c86b1ab48f762ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.809473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358c325b268a481b8c86b1ab48f762ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.924589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358c325b268a481b8c86b1ab48f762ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.925214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358c325b268a481b8c86b1ab48f762ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.939044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1213/2410] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:59 2022] DELETE /identity/v3/users/358c325b268a481b8c86b1ab48f762ae => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:59.943550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.944154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.944154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.973300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:59.974607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.049930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1198/2411] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:00.063249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.066867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.137519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638f7e-d02c-40fc-93d0-0e5b8fecfa2a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.141463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48c2ba-1a0b-41b3-87ac-70334f4edb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:00.142088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48c2ba-1a0b-41b3-87ac-70334f4edb24 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.142375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48c2ba-1a0b-41b3-87ac-70334f4edb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.142649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48c2ba-1a0b-41b3-87ac-70334f4edb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.153910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48c2ba-1a0b-41b3-87ac-70334f4edb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:00.158026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48c2ba-1a0b-41b3-87ac-70334f4edb24 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:00.171578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1214/2412] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:00.968706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.972140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.998275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a535ab-1e58-474e-92a7-0770da2ca9fe None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.009562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.012254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.012866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.014459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] PATH_INFO: `/v3/projects/1d3cfc93edd343e9b0320a3a20031dad` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.016441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3cfc93edd343e9b0320a3a20031dad)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.022630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.201342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3cfc93edd343e9b0320a3a20031dad', 'request_id': 'req-6e974bf2-0ad6-423a-8887-3890aed8e18a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:01.969963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3cfc93edd343e9b0320a3a20031dad', 'request_id': 'req-6e974bf2-0ad6-423a-8887-3890aed8e18a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:01.981178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3cfc93edd343e9b0320a3a20031dad', 'request_id': 'req-6e974bf2-0ad6-423a-8887-3890aed8e18a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:02.010026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] The token cache is being invalidate because project 1d3cfc93edd343e9b0320a3a20031dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:02.011212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:02.014227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e974bf2-0ad6-423a-8887-3890aed8e18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:02.017483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1199/2413] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:00 2022] DELETE /identity/v3/projects/1d3cfc93edd343e9b0320a3a20031dad => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:02.024406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79205-5803-409c-9815-41912c40cd09 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.025833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79205-5803-409c-9815-41912c40cd09 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.027284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79205-5803-409c-9815-41912c40cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.065061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-63f79205-5803-409c-9815-41912c40cd09 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:02.066439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-63f79205-5803-409c-9815-41912c40cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:02.090020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:02.152203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1215/2414] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:02.161310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423d11-0149-45d3-901d-94de57062d1b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.162147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423d11-0149-45d3-901d-94de57062d1b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.162573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423d11-0149-45d3-901d-94de57062d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.185086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-82423d11-0149-45d3-901d-94de57062d1b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:02.186334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-82423d11-0149-45d3-901d-94de57062d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:02.194725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1200/2415] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:02.199726 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79205-5803-409c-9815-41912c40cd09 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.209899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79205-5803-409c-9815-41912c40cd09 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.215453 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.216101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.216383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.216653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.217309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:02.218218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.219258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.232917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1216/2416] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:02.243676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423d11-0149-45d3-901d-94de57062d1b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.253673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423d11-0149-45d3-901d-94de57062d1b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.258445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.259101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.259445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.259717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.260502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.262561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.278789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:02.407009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1201/2417] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:02.411576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.431974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a9d3-b42c-41e4-b7cb-a25795d0972d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.547949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.549003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.549529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.550170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.551381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.555433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.658233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1217/2418] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:02.662641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.674342 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c262-1b1f-45f5-88b5-e2bd073b3eee admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.679395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.680066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.680381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.680662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.681299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.683095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.694034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1202/2419] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:02.698606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.709120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c78b1-3534-42d4-b4cd-ea2029f0a134 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.716166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458e346-5dcd-4649-b27a-47a5d67ee75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.716825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e346-5dcd-4649-b27a-47a5d67ee75d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.717112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e346-5dcd-4649-b27a-47a5d67ee75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.717391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e346-5dcd-4649-b27a-47a5d67ee75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.718064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458e346-5dcd-4649-b27a-47a5d67ee75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.719944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458e346-5dcd-4649-b27a-47a5d67ee75d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.733393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1218/2420] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:02.740153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.753848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fc255-8964-404f-883d-3d37b1e614a2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.759896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.760669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.761182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.761515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] PATH_INFO: `/v3/projects/5a632f82f9d941f896f6f4022c73fa95/users/12fba516ad734b15abefaba506532ce9/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.785204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a632f82f9d941f896f6f4022c73fa95, user_id=12fba516ad734b15abefaba506532ce9, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.788692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.892681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1203/2421] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:02 2022] PUT /identity/v3/projects/5a632f82f9d941f896f6f4022c73fa95/users/12fba516ad734b15abefaba506532ce9/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:02.978356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017212-d844-4949-b4ec-79e477820012 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.978980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017212-d844-4949-b4ec-79e477820012 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.979297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017212-d844-4949-b4ec-79e477820012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.010462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-94017212-d844-4949-b4ec-79e477820012 None None] MFA Rules not processed for user `12fba516ad734b15abefaba506532ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:03.012276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-94017212-d844-4949-b4ec-79e477820012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.091255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1219/2422] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:03.113343 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.115265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.197565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0228-06fc-4cb3-9789-c5c3d22f83ae admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.202265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68071674452b42839ffac496a902737d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.202934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.203221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.203499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.221745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.224763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.244319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1204/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:03.812472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.812658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.812893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.836208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] MFA Rules not processed for user `356dc6f47f454900ba6a7b7ee7a481fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:03.838129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.852401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:03.905758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1220/2424] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:03.923315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.924847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.028909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83226f-388f-4bf2-8f41-f5d4676ee609 service glance] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.035069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf51aca728a64f6ba4c143377a24b345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.035758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.036115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.036419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.051081 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.054153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.068056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1205/2425] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 05:46:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:06.711791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:06.712246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:06.778317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397eef-24cb-4207-9160-27c49925a268 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:06.782754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:06.783416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:06.783698 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:06.783978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:06.785991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:06.878083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:06.880187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:06.903324 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1221/2426] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:11.648865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.651873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.668947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc21b-4ef2-4449-b77e-9ba3e95d6eb5 service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:11.673988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:11.674683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.674997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.675275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] PATH_INFO: `/v3/users/e1942539e3374378b0b3d7942f6304b3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.676482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1942539e3374378b0b3d7942f6304b3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:11.678457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:11.934536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:11.936230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1942539e3374378b0b3d7942f6304b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.948975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1942539e3374378b0b3d7942f6304b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.949735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1942539e3374378b0b3d7942f6304b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.017291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1942539e3374378b0b3d7942f6304b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.027907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ea53b737-75a7-445b-b65f-30db63d0c9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1942539e3374378b0b3d7942f6304b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.036016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1206/2427] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:11 2022] DELETE /identity/v3/users/e1942539e3374378b0b3d7942f6304b3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:12.348718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.365898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd12216-e667-4167-b14e-46c53c728c0b service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.442603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.443448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.443806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.444022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] PATH_INFO: `/v3/projects/294826048813418e94b64571618f5e38` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.445190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294826048813418e94b64571618f5e38)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.447325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.467948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.625510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294826048813418e94b64571618f5e38', 'request_id': 'req-96a93831-897d-4d02-a536-e575c630ab93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.721193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294826048813418e94b64571618f5e38', 'request_id': 'req-96a93831-897d-4d02-a536-e575c630ab93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.727892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294826048813418e94b64571618f5e38', 'request_id': 'req-96a93831-897d-4d02-a536-e575c630ab93'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.743150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] The token cache is being invalidate because project 294826048813418e94b64571618f5e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:12.752493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.752493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-96a93831-897d-4d02-a536-e575c630ab93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:12.752493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1222/2428] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:12 2022] DELETE /identity/v3/projects/294826048813418e94b64571618f5e38 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:12.754534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.755098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.755287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.782731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.783963 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.871035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1207/2429] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:12.879671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.879957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.880238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.910405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.913345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.943136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1223/2430] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:12.948878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.960308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed077a-7256-4cf8-9c95-2dfe7ac80adb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.966851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.967808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.969026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.969026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.969323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:12.969586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.972807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.990603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1208/2431] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:12.996611 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.007850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26c1b9-0a23-4b0e-bb18-d956ffcc6796 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.013025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.013724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.014281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.014445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.015185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.017711 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.145473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1224/2432] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:13.150234 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.162268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51868c-fea8-44ee-82ab-387b931f38ca admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.233339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.234083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.234476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.234880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.235729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.238094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.358364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1209/2433] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:13.363282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.378012 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870ca4-771c-4961-939b-1c50ee9ce99b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.384328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.386226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.386848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.391994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.407543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1225/2434] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:13.412293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.425861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b6cf2-25be-43af-a851-a13f20b28b23 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.433563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebe6e-821a-402b-8fb2-005b8a0a0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.434319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebe6e-821a-402b-8fb2-005b8a0a0fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.434658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebe6e-821a-402b-8fb2-005b8a0a0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.435103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebe6e-821a-402b-8fb2-005b8a0a0fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.435868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ebe6e-821a-402b-8fb2-005b8a0a0fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.437636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ebe6e-821a-402b-8fb2-005b8a0a0fa5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.450410 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1210/2435] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:13.454786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.467730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7273e-fbaf-4233-b82c-f2e2a606b6bf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.473671 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.474359 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.474639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.474949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] PATH_INFO: `/v3/projects/88c15e2941dc45528fb8ed0ab08ffc4c/users/9b5afa54314945bb82454a336c20434c/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.493383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c15e2941dc45528fb8ed0ab08ffc4c, user_id=9b5afa54314945bb82454a336c20434c, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.497033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.621914 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1226/2436] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:13 2022] PUT /identity/v3/projects/88c15e2941dc45528fb8ed0ab08ffc4c/users/9b5afa54314945bb82454a336c20434c/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:13.636654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.637216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.637626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.672334 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] MFA Rules not processed for user `9b5afa54314945bb82454a336c20434c`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:13.673587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.695533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:13.752290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1211/2437] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:13.757000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.837011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a047-3f64-4cdf-9f6b-90e1591bd7b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.842815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.843472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.843772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.844062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.844708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.846624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.979941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1227/2438] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:13.985663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.007191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cae50-64d9-4ea2-882b-b6a6b15021ba None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.124027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.125086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.125581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.126079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.127303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.131146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.266178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1212/2439] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:14.270895 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.288957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a9e5-e937-4947-8d30-1460bc03c1a5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.298398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.301824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.301824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.301824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.302150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.304917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.336131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1228/2440] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:14.341492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.363243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d13cc-5f21-4664-b6d5-1461bf037280 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.371092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.372015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.372326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.372602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] PATH_INFO: `/v3/projects/f732c1a4099443e1abf4afd66bbcf59c/users/5c37b97a878b44ec914c9215696c71e7/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.393108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f732c1a4099443e1abf4afd66bbcf59c, user_id=5c37b97a878b44ec914c9215696c71e7, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.396139 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.499995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1213/2441] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:14 2022] PUT /identity/v3/projects/f732c1a4099443e1abf4afd66bbcf59c/users/5c37b97a878b44ec914c9215696c71e7/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:14.504958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.517161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1186fd-bcdb-4739-a041-7b3f9ffcf990 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.531059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.580761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4279dd-9f41-47e3-a6d9-63df6d367c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.581368 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4279dd-9f41-47e3-a6d9-63df6d367c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.581665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4279dd-9f41-47e3-a6d9-63df6d367c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.581943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4279dd-9f41-47e3-a6d9-63df6d367c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.582558 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4279dd-9f41-47e3-a6d9-63df6d367c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.584197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4279dd-9f41-47e3-a6d9-63df6d367c53 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.598112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1229/2442] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:14.599448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.610640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b2893-bdbc-48ff-95a4-f420909c7a45 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.615882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.616592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.616938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.617202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] PATH_INFO: `/v3/projects/f732c1a4099443e1abf4afd66bbcf59c/users/5c37b97a878b44ec914c9215696c71e7/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.619293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f732c1a4099443e1abf4afd66bbcf59c, user_id=5c37b97a878b44ec914c9215696c71e7, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.622908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.644789 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1214/2443] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:14 2022] PUT /identity/v3/projects/f732c1a4099443e1abf4afd66bbcf59c/users/5c37b97a878b44ec914c9215696c71e7/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:14.657622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.658035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.658282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.691505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] MFA Rules not processed for user `5c37b97a878b44ec914c9215696c71e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:14.695437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.781665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1230/2444] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:14.795145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.797012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.859738 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885dd8-b29b-4fb3-b18f-c715343e3c45 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.863937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e430f26-308f-4950-b9fc-6d42ee6f40fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.864559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e430f26-308f-4950-b9fc-6d42ee6f40fe service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.864848 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e430f26-308f-4950-b9fc-6d42ee6f40fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.865119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e430f26-308f-4950-b9fc-6d42ee6f40fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.876640 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e430f26-308f-4950-b9fc-6d42ee6f40fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.878097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e430f26-308f-4950-b9fc-6d42ee6f40fe service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.889861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1215/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:16.150154 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.229923 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc76671-f0f4-42c4-ab66-bf67fd40e8ee None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.234962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.235626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.235908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.236181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] PATH_INFO: `/v3/users/9b5afa54314945bb82454a336c20434c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.237397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5afa54314945bb82454a336c20434c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.239505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.429085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:16.439506 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5afa54314945bb82454a336c20434c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.440198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5afa54314945bb82454a336c20434c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.454155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5afa54314945bb82454a336c20434c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.554562 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5afa54314945bb82454a336c20434c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.555207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5afa54314945bb82454a336c20434c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.569987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1231/2446] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:16 2022] DELETE /identity/v3/users/9b5afa54314945bb82454a336c20434c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:16.574992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.575490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.575618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.595472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:16.596696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.608383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:16.678144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1216/2447] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:16.691221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.693016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.785146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2845d9-cd1e-4a9b-91ae-443b0f3a0a47 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.788940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.789573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.789856 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.790132 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.804533 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.806035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.818022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1232/2448] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:17.422662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.425113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.458143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db159-d54b-4393-98a8-63470f9b3fd1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.464661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.466421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.466421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.466421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] PATH_INFO: `/v3/projects/88c15e2941dc45528fb8ed0ab08ffc4c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.467549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c15e2941dc45528fb8ed0ab08ffc4c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.469485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.618821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c15e2941dc45528fb8ed0ab08ffc4c', 'request_id': 'req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:17.702564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c15e2941dc45528fb8ed0ab08ffc4c', 'request_id': 'req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:17.709905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c15e2941dc45528fb8ed0ab08ffc4c', 'request_id': 'req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:17.722267 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] The token cache is being invalidate because project 88c15e2941dc45528fb8ed0ab08ffc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:17.722559 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:17.723251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:17.724751 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1217/2449] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:17 2022] DELETE /identity/v3/projects/88c15e2941dc45528fb8ed0ab08ffc4c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:17.728916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.739520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec6804-6987-411b-8643-f245eb528280 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.802022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.802665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.802976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.803252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] PATH_INFO: `/v3/users/5c37b97a878b44ec914c9215696c71e7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.804409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c37b97a878b44ec914c9215696c71e7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.806430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:18.091427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c37b97a878b44ec914c9215696c71e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:18.092512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c37b97a878b44ec914c9215696c71e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:18.101819 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:18.108316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c37b97a878b44ec914c9215696c71e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:18.234195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c37b97a878b44ec914c9215696c71e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:18.235083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a537fa8-44cc-4bf7-8e13-a7dc18690f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c37b97a878b44ec914c9215696c71e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:18.250007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1233/2450] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:17 2022] DELETE /identity/v3/users/5c37b97a878b44ec914c9215696c71e7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:18.840755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:18.842892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:18.861269 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a167f-e7f0-48c8-b1d9-7c4f00738d5f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:18.925657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:18.926308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.926588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.926894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] PATH_INFO: `/v3/projects/f732c1a4099443e1abf4afd66bbcf59c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.928068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f732c1a4099443e1abf4afd66bbcf59c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:18.930019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.050502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.057468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f732c1a4099443e1abf4afd66bbcf59c', 'request_id': 'req-77a5747a-8604-4e00-b65e-157eb95e3cce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.187385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f732c1a4099443e1abf4afd66bbcf59c', 'request_id': 'req-77a5747a-8604-4e00-b65e-157eb95e3cce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.196176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f732c1a4099443e1abf4afd66bbcf59c', 'request_id': 'req-77a5747a-8604-4e00-b65e-157eb95e3cce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.211207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] The token cache is being invalidate because project f732c1a4099443e1abf4afd66bbcf59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:19.215440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.215440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-77a5747a-8604-4e00-b65e-157eb95e3cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.217389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1218/2451] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:18 2022] DELETE /identity/v3/projects/f732c1a4099443e1abf4afd66bbcf59c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:19.222386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.222956 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.246478 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:19.247848 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.316220 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1234/2452] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:19.324352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781601-55a0-4695-994f-251bc11c401b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.327498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781601-55a0-4695-994f-251bc11c401b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.327498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781601-55a0-4695-994f-251bc11c401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.346312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e2781601-55a0-4695-994f-251bc11c401b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:19.347591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e2781601-55a0-4695-994f-251bc11c401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.375311 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1219/2453] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:19.376392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.389794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd746c0-2209-4fd5-8ec6-bba20ab0475c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.401044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.402307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.402568 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.402874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.403749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:19.403889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.405526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.422291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1235/2454] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:19.428980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2781601-55a0-4695-994f-251bc11c401b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.446324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2781601-55a0-4695-994f-251bc11c401b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.455292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.459614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.459614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.459614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.459614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.460619 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.611305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1220/2455] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:19 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:19.616069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.627433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e24f-2e56-4cde-aaec-7bd216e74401 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.693804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.694318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.694592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.694922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.695590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.697553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.796762 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1236/2456] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:19 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:19.801620 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.813756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41314d09-403b-45b9-8172-1d46ba32b106 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.819720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.821002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.821701 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.823793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.825066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.827802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.843521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1221/2457] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:19.847991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.861187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4904-67e1-4e1b-9949-a47c6ac8d1d0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.866165 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a2930-1586-40ee-9e3d-6718e8321a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.866829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2930-1586-40ee-9e3d-6718e8321a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.867110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2930-1586-40ee-9e3d-6718e8321a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.867378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2930-1586-40ee-9e3d-6718e8321a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.868032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2930-1586-40ee-9e3d-6718e8321a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.869666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2930-1586-40ee-9e3d-6718e8321a78 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.882302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1237/2458] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:19.889425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.905808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1b81-3a15-4208-802d-ab1651c7bf36 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.910726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.911422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.911705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.911986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] PATH_INFO: `/v3/projects/d946d5fe5c874671a597ab8d4e211a21/users/df3911b5263949cb9282ebeec2df0256/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.931516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d946d5fe5c874671a597ab8d4e211a21, user_id=df3911b5263949cb9282ebeec2df0256, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.934365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.035143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1222/2459] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:19 2022] PUT /identity/v3/projects/d946d5fe5c874671a597ab8d4e211a21/users/df3911b5263949cb9282ebeec2df0256/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:20.047765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.048120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.048542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.081948 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] MFA Rules not processed for user `df3911b5263949cb9282ebeec2df0256`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:20.083241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.116512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.156253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1238/2460] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:20.160754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.254782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34dd96-4f20-482e-83ce-940d29b698e1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.264210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.265265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.265759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.266248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.267482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.271626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.398348 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1223/2461] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:20 2022] POST /identity/v3/projects => generated 363 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:20.398755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.413712 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ef03-207b-4adf-b7a0-952a54aef071 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.497841 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.498470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.498860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.499311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.500718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.503687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.642714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1239/2462] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:20 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:20.645007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.656885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6b78-0ce2-4e30-9579-a60610990485 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.662003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.662766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.663117 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.663462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.664297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.666015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.681443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1224/2463] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:20.686624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.700721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563ee4c-be26-48aa-b248-3c1e5dddf790 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.705837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.707929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.707929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.707929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] PATH_INFO: `/v3/projects/d0bf4939d21542409a2e1561561aba05/users/af84358d306b484483a8306e86f2f4fc/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.723893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bf4939d21542409a2e1561561aba05, user_id=af84358d306b484483a8306e86f2f4fc, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.726576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.822793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1240/2464] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:20 2022] PUT /identity/v3/projects/d0bf4939d21542409a2e1561561aba05/users/af84358d306b484483a8306e86f2f4fc/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:20.826400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.842577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffcbb0-db04-47a6-ba5f-bd2e87821f36 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.890636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.920351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2d83-efa5-4c60-bad9-f141d11002e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.921653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2d83-efa5-4c60-bad9-f141d11002e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.921938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2d83-efa5-4c60-bad9-f141d11002e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.922512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2d83-efa5-4c60-bad9-f141d11002e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.923545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2d83-efa5-4c60-bad9-f141d11002e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.927886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2d83-efa5-4c60-bad9-f141d11002e1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.961494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1225/2465] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:20.966629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.987356 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69812392-86f7-4c3e-b79e-a32740e75d1f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.996807 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.997969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.998470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.999037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] PATH_INFO: `/v3/projects/d0bf4939d21542409a2e1561561aba05/users/af84358d306b484483a8306e86f2f4fc/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.014215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bf4939d21542409a2e1561561aba05, user_id=af84358d306b484483a8306e86f2f4fc, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.014215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.042028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1241/2466] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:20 2022] PUT /identity/v3/projects/d0bf4939d21542409a2e1561561aba05/users/af84358d306b484483a8306e86f2f4fc/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:21.054654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.055077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.055437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.094511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] MFA Rules not processed for user `af84358d306b484483a8306e86f2f4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:21.096097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.234452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1226/2467] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:21.246177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:21.248542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.334317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d625ae-c5e6-480f-9c39-de458ac53197 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:21.341953 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6e8c-a70d-4961-9a0e-016515e3b963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:21.342873 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6e8c-a70d-4961-9a0e-016515e3b963 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.343221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6e8c-a70d-4961-9a0e-016515e3b963 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.343501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6e8c-a70d-4961-9a0e-016515e3b963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.355905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6e8c-a70d-4961-9a0e-016515e3b963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.357688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6e8c-a70d-4961-9a0e-016515e3b963 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.369061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1242/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:22.720388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:22.818990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75144f-298f-4995-927b-5f0ecfe0ec47 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:22.828220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:22.829325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:22.829807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:22.830283 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] PATH_INFO: `/v3/users/df3911b5263949cb9282ebeec2df0256` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:22.832460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3911b5263949cb9282ebeec2df0256)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:22.836439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:23.076674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3911b5263949cb9282ebeec2df0256'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.088499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:23.092018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3911b5263949cb9282ebeec2df0256'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.092754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3911b5263949cb9282ebeec2df0256'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.162840 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3911b5263949cb9282ebeec2df0256'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.172598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3911b5263949cb9282ebeec2df0256'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.179499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1227/2469] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:22 2022] DELETE /identity/v3/users/df3911b5263949cb9282ebeec2df0256 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:23.184235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.184743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.184868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.206224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:23.207476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.233033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:23.275148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1243/2470] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:23.287513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:23.289891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.359878 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065120-01b2-4233-806a-9e7756212211 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:23.363706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:23.364328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.364653 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.364931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.374781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:23.376227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:23.390013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1228/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:23.909246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:23.913273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.938439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e048343-0a8d-48bc-b7c2-dc8d954b33bf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:23.949010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:23.949601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.949944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.950361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] PATH_INFO: `/v3/projects/d946d5fe5c874671a597ab8d4e211a21` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.952706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d946d5fe5c874671a597ab8d4e211a21)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:23.955174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.088118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd946d5fe5c874671a597ab8d4e211a21', 'request_id': 'req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.188278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd946d5fe5c874671a597ab8d4e211a21', 'request_id': 'req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.195392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd946d5fe5c874671a597ab8d4e211a21', 'request_id': 'req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.208000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] The token cache is being invalidate because project d946d5fe5c874671a597ab8d4e211a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:24.208269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.208936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.210493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1244/2472] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:23 2022] DELETE /identity/v3/projects/d946d5fe5c874671a597ab8d4e211a21 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:24.215378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.225886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320a3ab-383d-418c-9a77-8410fa900be5 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.317399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.318406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.321857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.321857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] PATH_INFO: `/v3/users/af84358d306b484483a8306e86f2f4fc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.321857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af84358d306b484483a8306e86f2f4fc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.323749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.561858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af84358d306b484483a8306e86f2f4fc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.584382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af84358d306b484483a8306e86f2f4fc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.585330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af84358d306b484483a8306e86f2f4fc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.703114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af84358d306b484483a8306e86f2f4fc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.711920 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e125fd98-efd2-482c-861a-8128d2195b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af84358d306b484483a8306e86f2f4fc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.714898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:24.721130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1229/2473] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:24 2022] DELETE /identity/v3/users/af84358d306b484483a8306e86f2f4fc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:25.444981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.453491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.471061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0d1c-b1af-4d7d-ac75-4d32230489e3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.548017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.548588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.548868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.549153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] PATH_INFO: `/v3/projects/d0bf4939d21542409a2e1561561aba05` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.550400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bf4939d21542409a2e1561561aba05)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.552431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.677054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bf4939d21542409a2e1561561aba05', 'request_id': 'req-dc5cc139-70e6-4310-82ab-be9368c00d54'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.680546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:25.794319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bf4939d21542409a2e1561561aba05', 'request_id': 'req-dc5cc139-70e6-4310-82ab-be9368c00d54'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.802365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bf4939d21542409a2e1561561aba05', 'request_id': 'req-dc5cc139-70e6-4310-82ab-be9368c00d54'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.815690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] The token cache is being invalidate because project d0bf4939d21542409a2e1561561aba05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:25.815997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.817196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc5cc139-70e6-4310-82ab-be9368c00d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.818771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1245/2474] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:25 2022] DELETE /identity/v3/projects/d0bf4939d21542409a2e1561561aba05 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:25.825148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.826588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.826588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.850558 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:25.855417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.926440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1230/2475] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:25.935586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.935862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.936128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.958300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:25.959567 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.969770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1246/2476] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:25.979242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.997702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4d80-2256-4fd1-8f2b-c9617bbd51f9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.006997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.007742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.008026 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.008304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.009110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:26.009278 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.011469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.028395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1231/2477] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:26.035096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.045573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e42fab-c084-4f53-a196-09eeef633f1f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.051480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.052116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.052452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.052663 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.053305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.055295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.157716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1247/2478] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:26.162180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.178884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59585e-09fe-44a6-bc1b-57b77c43be16 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.261436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.261436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.261436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.262204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.262357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.264432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.441436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1232/2479] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:26.446491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.459229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce1f3b-027f-40e5-8865-367548901deb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.465439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.466200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.466522 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.466879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.467564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.469297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.481828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1248/2480] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:26.486433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.498715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b08b2-6151-45f4-9cc8-8b30da3747f9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.504238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f356-dc96-4ea1-987e-b677d327a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.504863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f356-dc96-4ea1-987e-b677d327a1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.505145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f356-dc96-4ea1-987e-b677d327a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.505418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f356-dc96-4ea1-987e-b677d327a1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.506067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6f356-dc96-4ea1-987e-b677d327a1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.507807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6f356-dc96-4ea1-987e-b677d327a1cf admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.528242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1233/2481] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:26.533417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.552354 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf041f8-3314-43e8-af2a-2bb800e83fb6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.565207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.565207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.565207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.565207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] PATH_INFO: `/v3/projects/0599fdafccd24d94853358b76b0ef332/users/12f816452d3a4f9c876630ccbe1e62d8/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.591150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0599fdafccd24d94853358b76b0ef332, user_id=12f816452d3a4f9c876630ccbe1e62d8, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.596601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.699227 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1249/2482] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:26 2022] PUT /identity/v3/projects/0599fdafccd24d94853358b76b0ef332/users/12f816452d3a4f9c876630ccbe1e62d8/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:26.710677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.711077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.711480 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.745742 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] MFA Rules not processed for user `12f816452d3a4f9c876630ccbe1e62d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:26.747232 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.825326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:26.834946 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1234/2483] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:26.844201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.942003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced4a95-99ef-4e1c-b43e-9d29d6ad3651 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.946809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.947424 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.947705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.948052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.948696 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.950780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.074312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1250/2484] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/projects => generated 367 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:27.079057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.091184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3deaa-e9c1-46dc-81d8-1c1d925a61cb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.160752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.161388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.161673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.161951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.162607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.164800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.301021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1235/2485] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:27.306272 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.324898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31090f6-c2e3-4791-be12-4d3ee0586150 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.333323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.334274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.334829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.335483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.336715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.340411 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.362557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1251/2486] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:27.367163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.378569 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2ea5-e409-4925-99ad-c3d35fb942ae admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.387290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.387976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.388261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.388535 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] PATH_INFO: `/v3/projects/d6bbe2969c2848bf88ebae5749894cfd/users/8c3f671b98b1403f8f9172bcd12bc306/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.408008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bbe2969c2848bf88ebae5749894cfd, user_id=8c3f671b98b1403f8f9172bcd12bc306, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.412252 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.659720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1236/2487] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:27 2022] PUT /identity/v3/projects/d6bbe2969c2848bf88ebae5749894cfd/users/8c3f671b98b1403f8f9172bcd12bc306/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:27.665448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.676378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a940f43-4da2-4b9d-9f8e-77726fb11ef2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.741017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:27.757284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e2ef-e138-4463-9e74-df42839a909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.758026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e2ef-e138-4463-9e74-df42839a909f admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.758427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e2ef-e138-4463-9e74-df42839a909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.758840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e2ef-e138-4463-9e74-df42839a909f admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.759891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463e2ef-e138-4463-9e74-df42839a909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.763049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463e2ef-e138-4463-9e74-df42839a909f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.778439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1252/2488] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:27.782065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.794599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73107d9b-7a60-4725-9e75-786157d8e7fa admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.804580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.805441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.805799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.806149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] PATH_INFO: `/v3/projects/d6bbe2969c2848bf88ebae5749894cfd/users/8c3f671b98b1403f8f9172bcd12bc306/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.811804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bbe2969c2848bf88ebae5749894cfd, user_id=8c3f671b98b1403f8f9172bcd12bc306, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.816688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.845377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1237/2489] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:27 2022] PUT /identity/v3/projects/d6bbe2969c2848bf88ebae5749894cfd/users/8c3f671b98b1403f8f9172bcd12bc306/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:27.869490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.871245 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.872091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.920238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] MFA Rules not processed for user `8c3f671b98b1403f8f9172bcd12bc306`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:27.922626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:28.026409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1253/2490] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:28.038293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:28.040246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:28.109780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e28b-f6b8-4f40-afa5-ced2b86f4a42 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.113900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.114548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.114870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.115149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.127645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:28.129142 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:28.141781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1238/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:29.366834 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.369105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.454009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4343-b6f7-4207-b0ac-119acf0f43b1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.460394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.461549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.462052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.462473 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.465625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.561017 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.562664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064856c-1ad4-49ae-b21d-5137f5d454f0 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.573749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1254/2492] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:30.088102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.090950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.118027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ef3c-3e58-4966-b6d0-9f342689ff81 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.126380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.127580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.128066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.128564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] PATH_INFO: `/v3/users/12fba516ad734b15abefaba506532ce9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.130939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fba516ad734b15abefaba506532ce9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.134592 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.430075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:30.433454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fba516ad734b15abefaba506532ce9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:30.464366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fba516ad734b15abefaba506532ce9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:30.465442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fba516ad734b15abefaba506532ce9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:30.546748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fba516ad734b15abefaba506532ce9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:30.554675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fba516ad734b15abefaba506532ce9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:30.562474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1239/2493] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:30 2022] DELETE /identity/v3/users/12fba516ad734b15abefaba506532ce9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:30.567047 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.567576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.567576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.597740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:30.600117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.647458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:30.742823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1255/2494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:30.753266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.754804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.854563 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd355-79a5-4fc4-a767-a8522531ffc9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.858733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b436-7dbe-4860-af11-d14727a4fb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.859509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b436-7dbe-4860-af11-d14727a4fb75 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.859786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b436-7dbe-4860-af11-d14727a4fb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.860063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b436-7dbe-4860-af11-d14727a4fb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.870980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3b436-7dbe-4860-af11-d14727a4fb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.872605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3b436-7dbe-4860-af11-d14727a4fb75 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.884056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1240/2495] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:31.649549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.652240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:31.665624 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9683a-8cba-4086-9520-98b903c63e9d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.705661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.707084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.709238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.709798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] PATH_INFO: `/v3/projects/5a632f82f9d941f896f6f4022c73fa95` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.712273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a632f82f9d941f896f6f4022c73fa95)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.715391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.872650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a632f82f9d941f896f6f4022c73fa95', 'request_id': 'req-b4226f5e-58e1-49e0-aa38-c3ebe7431037'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:31.961468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a632f82f9d941f896f6f4022c73fa95', 'request_id': 'req-b4226f5e-58e1-49e0-aa38-c3ebe7431037'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:31.970138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a632f82f9d941f896f6f4022c73fa95', 'request_id': 'req-b4226f5e-58e1-49e0-aa38-c3ebe7431037'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:31.985617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] The token cache is being invalidate because project 5a632f82f9d941f896f6f4022c73fa95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:31.986208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:31.987201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b4226f5e-58e1-49e0-aa38-c3ebe7431037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:31.991229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1256/2496] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:31 2022] DELETE /identity/v3/projects/5a632f82f9d941f896f6f4022c73fa95 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:31.997072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.997918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.998374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.023969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:32.025637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.131368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1241/2497] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:32.143045 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c564-5272-4a59-867e-44783ea858cf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.143541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c564-5272-4a59-867e-44783ea858cf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.144526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c564-5272-4a59-867e-44783ea858cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.175491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6499c564-5272-4a59-867e-44783ea858cf None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:32.176630 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6499c564-5272-4a59-867e-44783ea858cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.186066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1257/2498] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:32.190821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.202732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af549f1e-e92b-4ab3-886e-144b0069b90b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.211692 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.212545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.212909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.213644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.214454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:32.215037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.217058 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.234622 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1242/2499] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:32.248209 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c564-5272-4a59-867e-44783ea858cf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.253247 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.258781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.264281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c564-5272-4a59-867e-44783ea858cf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.273180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.273916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.274263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.274600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.275674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.278553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.282187 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a251e1-c240-41d7-967b-e429f1b3d50e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.290891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.292444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.293476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.293822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] PATH_INFO: `/v3/users/12f816452d3a4f9c876630ccbe1e62d8` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.295685 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f816452d3a4f9c876630ccbe1e62d8)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.298792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.510186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1258/2500] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:32.515673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.600373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f867-a173-4739-aaeb-dd6e2076dc6b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.612670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.613425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.613703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.613971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.614860 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.616858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.698836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f816452d3a4f9c876630ccbe1e62d8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:32.700670 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:32.730060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f816452d3a4f9c876630ccbe1e62d8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:32.731818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f816452d3a4f9c876630ccbe1e62d8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:32.766376 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1259/2501] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/users => generated 282 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:32.771467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.786916 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011b675-9440-4f60-9525-1382f74864a8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.793676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.794347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.794634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.794940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.795612 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.797253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.799033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:32.810369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1260/2502] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:32.815852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.830686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631ca39-0344-4d32-ab5b-722d75e07984 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.840978 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.841975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.842312 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.842797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.844111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.846415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.866225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1261/2503] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:32.872577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.880020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f816452d3a4f9c876630ccbe1e62d8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:32.888464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de694fd2-4c06-4a3f-a9fb-1d49bf42d0cf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.890478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-483879cc-a623-47fe-b0ae-44edbb29afd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f816452d3a4f9c876630ccbe1e62d8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:32.894620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.895623 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.897013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.897341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] PATH_INFO: `/v3/projects/ae54e46d39e643da9e84738137fae04d/users/e73c9517bc8b44d9acf7403ce46327c8/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.897836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1243/2504] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:32 2022] DELETE /identity/v3/users/12f816452d3a4f9c876630ccbe1e62d8 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:32.904328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f0ee-4dd4-403e-ad53-9e99f663e84b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.904612 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f0ee-4dd4-403e-ad53-9e99f663e84b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.904941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f0ee-4dd4-403e-ad53-9e99f663e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.917255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae54e46d39e643da9e84738137fae04d, user_id=e73c9517bc8b44d9acf7403ce46327c8, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.919852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.952303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b4f9f0ee-4dd4-403e-ad53-9e99f663e84b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:32.952512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b4f9f0ee-4dd4-403e-ad53-9e99f663e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.038483 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1244/2505] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:33.049919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1262/2506] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:32 2022] PUT /identity/v3/projects/ae54e46d39e643da9e84738137fae04d/users/e73c9517bc8b44d9acf7403ce46327c8/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:33.054163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.054375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.054642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.055258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.057560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.119013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] MFA Rules not processed for user `e73c9517bc8b44d9acf7403ce46327c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:33.122474 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.179269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87143843-0b18-48d8-a83a-20d919a247e4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.179269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.179269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.179269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.179779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.269727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1245/2507] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:33.284335 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.285809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.293927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.296316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.311965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1263/2508] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:33.358009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dfce3-75d9-4be0-b143-4e102e2722e2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.362163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.362816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.363103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.363378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.373880 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.375486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.379465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:33.386514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1246/2509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:33.965944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.967484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.982495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3f1e-75cc-4252-80e9-7c4234622213 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.992480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.993215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.993503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.993776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] PATH_INFO: `/v3/projects/0599fdafccd24d94853358b76b0ef332` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.997416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0599fdafccd24d94853358b76b0ef332)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.000388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.201218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0599fdafccd24d94853358b76b0ef332', 'request_id': 'req-21be38d7-ebff-4ee1-9206-7f5a6187aa55'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.320824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0599fdafccd24d94853358b76b0ef332', 'request_id': 'req-21be38d7-ebff-4ee1-9206-7f5a6187aa55'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.338501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0599fdafccd24d94853358b76b0ef332', 'request_id': 'req-21be38d7-ebff-4ee1-9206-7f5a6187aa55'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.346088 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:34.364235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] The token cache is being invalidate because project 0599fdafccd24d94853358b76b0ef332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:34.364778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.365639 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.367776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1264/2510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:33 2022] DELETE /identity/v3/projects/0599fdafccd24d94853358b76b0ef332 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:34.389577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:34.408042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510d38-722f-4584-9581-1a19d51c2a71 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:34.500361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:34.501015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.501364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.501852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] PATH_INFO: `/v3/users/8c3f671b98b1403f8f9172bcd12bc306` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.503314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3f671b98b1403f8f9172bcd12bc306)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.505306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.742903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:34.745480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:34.761670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be38d7-ebff-4ee1-9206-7f5a6187aa55 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:34.766768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:34.767433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.767735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.768006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] PATH_INFO: `/v3/users/1e7b37a53a2644c5b4e75c6eb06792a1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.769467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7b37a53a2644c5b4e75c6eb06792a1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.771541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.810458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3f671b98b1403f8f9172bcd12bc306'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.823881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3f671b98b1403f8f9172bcd12bc306'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.824793 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3f671b98b1403f8f9172bcd12bc306'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.914004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3f671b98b1403f8f9172bcd12bc306'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.923122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3f671b98b1403f8f9172bcd12bc306'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.929614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1247/2511] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:34 2022] DELETE /identity/v3/users/8c3f671b98b1403f8f9172bcd12bc306 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:35.005417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7b37a53a2644c5b4e75c6eb06792a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.006078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7b37a53a2644c5b4e75c6eb06792a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.019991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7b37a53a2644c5b4e75c6eb06792a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.129543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7b37a53a2644c5b4e75c6eb06792a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.130625 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7b37a53a2644c5b4e75c6eb06792a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.155482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1265/2512] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:34 2022] DELETE /identity/v3/users/1e7b37a53a2644c5b4e75c6eb06792a1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:35.432771 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:35.434704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.446714 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:35.449651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.543020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e945-72a2-42d9-89e2-ac547c9541e4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:35.560701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89323-9daf-4785-977f-691a7e3197e3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:35.566737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:35.567069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:35.567430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.567713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.567983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] PATH_INFO: `/v3/projects/d6bbe2969c2848bf88ebae5749894cfd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.569148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bbe2969c2848bf88ebae5749894cfd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:35.571140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:35.620776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:35.621515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.621799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.622075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] PATH_INFO: `/v3/projects/6ba6e126e82649fd97faa737d33dafea` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.623297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba6e126e82649fd97faa737d33dafea)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:35.625262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:35.711098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bbe2969c2848bf88ebae5749894cfd', 'request_id': 'req-05df573e-d265-4045-8f73-a15fca11f911'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.737834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba6e126e82649fd97faa737d33dafea', 'request_id': 'req-026e2212-811c-450f-987c-ea9d3d5a9fac'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.817902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bbe2969c2848bf88ebae5749894cfd', 'request_id': 'req-05df573e-d265-4045-8f73-a15fca11f911'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.827757 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bbe2969c2848bf88ebae5749894cfd', 'request_id': 'req-05df573e-d265-4045-8f73-a15fca11f911'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.836295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:35.843931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] The token cache is being invalidate because project d6bbe2969c2848bf88ebae5749894cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:35.846362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.847318 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-05df573e-d265-4045-8f73-a15fca11f911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.848949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1266/2513] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:35 2022] DELETE /identity/v3/projects/d6bbe2969c2848bf88ebae5749894cfd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:35.855234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91ca79-3555-4cfe-b727-12136cc92471 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.855530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91ca79-3555-4cfe-b727-12136cc92471 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.856507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91ca79-3555-4cfe-b727-12136cc92471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.877500 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2b91ca79-3555-4cfe-b727-12136cc92471 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:35.878207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba6e126e82649fd97faa737d33dafea', 'request_id': 'req-026e2212-811c-450f-987c-ea9d3d5a9fac'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.878809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2b91ca79-3555-4cfe-b727-12136cc92471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.888753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba6e126e82649fd97faa737d33dafea', 'request_id': 'req-026e2212-811c-450f-987c-ea9d3d5a9fac'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.904059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] The token cache is being invalidate because project 6ba6e126e82649fd97faa737d33dafea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:35.904407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.905040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-026e2212-811c-450f-987c-ea9d3d5a9fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.906598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1248/2514] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:35 2022] DELETE /identity/v3/projects/6ba6e126e82649fd97faa737d33dafea => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:35.911451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f650dd-d8de-4f38-a426-730290c5f268 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.911735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f650dd-d8de-4f38-a426-730290c5f268 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.912017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f650dd-d8de-4f38-a426-730290c5f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.935945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-40f650dd-d8de-4f38-a426-730290c5f268 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:35.937618 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-40f650dd-d8de-4f38-a426-730290c5f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.973282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1267/2515] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:35.975505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.975877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.976201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.999393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.000731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.009273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1268/2516] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:36.014862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.023188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1249/2517] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:36.030906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9d72c-e0fa-466a-a856-4f95718692fe None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.037683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.037972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.038297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.041782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.042776 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.043257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.043529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.044189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:36.044549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.046169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.059845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.060466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1269/2518] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:36.061300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.072398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.074812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1250/2519] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:36.077836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.083507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b10c-52fe-4891-90bb-35e88ad90699 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.088539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6316-1b6b-4508-b3c8-edc4908b1dff None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.090189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.091033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.091470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.091943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.092651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.093926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.094606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.094908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.095191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.095486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.096140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:36.096436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.098040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.114502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1251/2520] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:36.115803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.126784 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4677be-66a1-4cb1-967e-3830a5e2faa5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.131488 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.136304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.136304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.136304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.136304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.136304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.193797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1270/2521] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:36.198169 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.267024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99539a6-8ddc-4738-9940-784c18118d74 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.272822 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.273518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.273794 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.274062 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.274719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.277331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.291200 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1252/2522] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:36.296723 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.366298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943ec75-f079-49d3-bef3-e6f0e785ee21 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.371336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.371957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.372233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.372498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.373167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.375204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.391599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1271/2523] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:36.391599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.401796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756e393-a59d-4105-93c0-e6cd74afe8f9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.406814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.407431 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.407709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.407977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.408660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.410415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.421893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1272/2524] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:36.426241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.436566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0a8d-1a7b-4f58-a7b2-cac4f2a451d8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.441366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.442077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.442378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.442654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.443361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.444976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.457804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1273/2525] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:36.462143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.473131 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6508db-a298-41b8-8660-8f68e9622b3e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.475957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1253/2526] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:36.480410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12454-05ef-409a-9718-477d591acae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.480410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12454-05ef-409a-9718-477d591acae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.480410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12454-05ef-409a-9718-477d591acae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.480410 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12454-05ef-409a-9718-477d591acae5 admin admin] PATH_INFO: `/v3/projects/1aadc9b01e9e4e55843bcc7403d4dd1c/users/20c922f4ace7474fbfa969da0bb7fa59/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.481838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.499089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12454-05ef-409a-9718-477d591acae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aadc9b01e9e4e55843bcc7403d4dd1c, user_id=20c922f4ace7474fbfa969da0bb7fa59, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.500693 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03debf3-3a76-4597-aeb1-d4af748c23b9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.501833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12454-05ef-409a-9718-477d591acae5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.510391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.511479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.512070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.512646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.513841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.516808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.537976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1254/2527] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:36.542926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.554259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0b87-168c-4985-abfd-3ff5ddbf1b56 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.559708 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.560374 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.560660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.560949 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.561604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.564892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.581924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1255/2528] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:36.586321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.598049 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ec0e5-c864-4682-ba26-278b3c4bd13c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.604743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e6458-b8c4-4716-898f-36bc7667a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.605966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6458-b8c4-4716-898f-36bc7667a463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.605966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6458-b8c4-4716-898f-36bc7667a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.605966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6458-b8c4-4716-898f-36bc7667a463 admin admin] PATH_INFO: `/v3/projects/37108ddbd8a840b3a8fd751ed03ea313/users/ab37d3e9e91d48d3b3d022effc2a2a43/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.627921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1274/2529] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:36 2022] PUT /identity/v3/projects/1aadc9b01e9e4e55843bcc7403d4dd1c/users/20c922f4ace7474fbfa969da0bb7fa59/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:36.640939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.641233 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.641344 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e6458-b8c4-4716-898f-36bc7667a463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37108ddbd8a840b3a8fd751ed03ea313, user_id=ab37d3e9e91d48d3b3d022effc2a2a43, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.641518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.647554 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e6458-b8c4-4716-898f-36bc7667a463 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.672641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] MFA Rules not processed for user `20c922f4ace7474fbfa969da0bb7fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.673900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.748802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1275/2530] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:36.753403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.769897 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1256/2531] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:36 2022] PUT /identity/v3/projects/37108ddbd8a840b3a8fd751ed03ea313/users/ab37d3e9e91d48d3b3d022effc2a2a43/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:36.782572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.782768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.782937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.817813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] MFA Rules not processed for user `ab37d3e9e91d48d3b3d022effc2a2a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.819084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.826039 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b130190-e4a0-42a6-9514-d4e2842421f7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.894724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.895620 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.896037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.896438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.897400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.901025 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.925262 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1257/2532] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:36.934623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.942302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f85cc3-3998-494f-b90d-4ac7c8c951c7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.947301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.947991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.948272 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.948543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.949173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.951167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.999828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.051403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1276/2533] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:37.055454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.087172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1258/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:37.092414 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.119069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637cefc-2ccc-435e-883d-8eb2b5d4b41e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.164544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8882-b68a-49b7-8581-dee000d888d6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.170430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.171392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.171697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.171999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.172724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.173193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.175106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.211893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.212523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.212809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.213654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.215121 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.217166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.286939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1259/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:37.291073 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.302197 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd5a7-f04b-4d50-8de6-544cea832d67 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.308003 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.313457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.313457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.313457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.313457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.313457 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.322632 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1260/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:37.326930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.338954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388f2d-e8fa-454e-9029-3bc5dc39f574 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.345323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.346111 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.347745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.347745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] PATH_INFO: `/v3/projects/e4fd0e12dd1449048d0e1fef86c73d5e/users/f4074f96276e4ff0b0d1e8c5272fe83f/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.355020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1277/2537] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:37.356737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.370133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fd0e12dd1449048d0e1fef86c73d5e, user_id=f4074f96276e4ff0b0d1e8c5272fe83f, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.370360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dc64-981f-4b0f-b2d7-2546d5501292 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.373295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.375597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.376222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.376495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.376781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.377429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.379435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.391362 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1278/2538] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:37.400394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.411911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a76a7a-9bb0-4db7-9c72-6fca661378ab admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.417501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.418184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.418891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.419243 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] PATH_INFO: `/v3/projects/a509d144700c45739d59848c59bc3fd6/users/1c8210c9059b4b39acd7878f22a657d3/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.445134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a509d144700c45739d59848c59bc3fd6, user_id=1c8210c9059b4b39acd7878f22a657d3, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.449250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.489881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1261/2539] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:37 2022] PUT /identity/v3/projects/e4fd0e12dd1449048d0e1fef86c73d5e/users/f4074f96276e4ff0b0d1e8c5272fe83f/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:37.493940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.559091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1279/2540] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:37 2022] PUT /identity/v3/projects/a509d144700c45739d59848c59bc3fd6/users/1c8210c9059b4b39acd7878f22a657d3/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:37.563533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53695b3-17d5-4c96-8e25-15d6d0d006a2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.564320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.627591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.628248 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.628623 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.628815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.629416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.631088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.646041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1262/2541] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:37.646253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66883dab-eaae-4d4a-9654-6d91ef7c682f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.647345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.651572 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.652179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.652454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.652724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.653417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.655074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.660363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90ff09-721b-45d5-8029-30a1404032d2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.666321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cf1e1-9c49-4eac-9a8f-1e8f19882af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.670130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cf1e1-9c49-4eac-9a8f-1e8f19882af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.670130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cf1e1-9c49-4eac-9a8f-1e8f19882af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.670130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cf1e1-9c49-4eac-9a8f-1e8f19882af8 admin admin] PATH_INFO: `/v3/projects/e4fd0e12dd1449048d0e1fef86c73d5e/users/f4074f96276e4ff0b0d1e8c5272fe83f/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.670584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1280/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:37.673331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cf1e1-9c49-4eac-9a8f-1e8f19882af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fd0e12dd1449048d0e1fef86c73d5e, user_id=f4074f96276e4ff0b0d1e8c5272fe83f, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.673565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.676238 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cf1e1-9c49-4eac-9a8f-1e8f19882af8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.687997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e65b5-799b-4249-8987-d6c108a250a9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.694810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1263/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:37 2022] PUT /identity/v3/projects/e4fd0e12dd1449048d0e1fef86c73d5e/users/f4074f96276e4ff0b0d1e8c5272fe83f/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:37.720242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.720745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.721236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.767513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] MFA Rules not processed for user `f4074f96276e4ff0b0d1e8c5272fe83f`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:37.769239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.774850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443970-ac95-43eb-ac05-0b6a7a6946bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.776401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443970-ac95-43eb-ac05-0b6a7a6946bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.776688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443970-ac95-43eb-ac05-0b6a7a6946bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.777365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443970-ac95-43eb-ac05-0b6a7a6946bf admin admin] PATH_INFO: `/v3/projects/a509d144700c45739d59848c59bc3fd6/users/1c8210c9059b4b39acd7878f22a657d3/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.779598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443970-ac95-43eb-ac05-0b6a7a6946bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a509d144700c45739d59848c59bc3fd6, user_id=1c8210c9059b4b39acd7878f22a657d3, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.782480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443970-ac95-43eb-ac05-0b6a7a6946bf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.795097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1281/2544] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:37 2022] PUT /identity/v3/projects/a509d144700c45739d59848c59bc3fd6/users/1c8210c9059b4b39acd7878f22a657d3/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:37.797015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.806335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.806646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.807648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.839868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.843505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] MFA Rules not processed for user `1c8210c9059b4b39acd7878f22a657d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:37.845598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.879195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1264/2545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:37.895816 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.897320 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.959427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1282/2546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:37.991417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a1c7-64aa-436e-9437-124983c642c8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.052478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.053099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.053379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.053663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.117298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.118885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.131054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1265/2547] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:38.189545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.191504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.195838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:38.206979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81017ec4-71e1-49fe-bddc-22415ce996a5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.210664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.211389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.211666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.211933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.223255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.224729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.235937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1283/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:38.331614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:38.452752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.463652 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4c64-d98f-4899-b22a-65f8a42e3efa service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.468124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.468745 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.469027 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.469303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.513653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.522878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff80e0-fa32-49d8-9a00-ef267c662a4f service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.527525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7dfd8-d2a0-4174-9fe6-79cb60a5093f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.528153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7dfd8-d2a0-4174-9fe6-79cb60a5093f service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.528573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7dfd8-d2a0-4174-9fe6-79cb60a5093f service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.528854 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7dfd8-d2a0-4174-9fe6-79cb60a5093f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.538288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.539824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.550305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1266/2549] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:38.590457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7dfd8-d2a0-4174-9fe6-79cb60a5093f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.592081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7dfd8-d2a0-4174-9fe6-79cb60a5093f service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.603287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1284/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:38.972018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:39.187397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:39.280458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4a75-0e00-4dd7-9ec7-9af8d57f0d66 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:39.288615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:39.289794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.290302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.291240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] PATH_INFO: `/v3/users/20c922f4ace7474fbfa969da0bb7fa59` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.293557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c922f4ace7474fbfa969da0bb7fa59)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:39.297951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:39.544087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c922f4ace7474fbfa969da0bb7fa59'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.557812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c922f4ace7474fbfa969da0bb7fa59'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.558561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c922f4ace7474fbfa969da0bb7fa59'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.669268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c922f4ace7474fbfa969da0bb7fa59'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.678208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c922f4ace7474fbfa969da0bb7fa59'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.685310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1267/2551] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:39 2022] DELETE /identity/v3/users/20c922f4ace7474fbfa969da0bb7fa59 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:39.694496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.695460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.695460 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.716463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:39.717699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:39.738208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:39.785383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1285/2552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:39.798533 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:39.799949 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:39.823304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:39.877046 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03875b9-74d0-464b-82ca-235bb28dde55 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:39.880987 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:39.881619 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.881904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.882186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.896289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:39.898172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:39.916392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1268/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:40.443934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.445823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.495059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b97768-5ea4-4030-ab08-9d662a2ccbba None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.514142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.515407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.515963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.516646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] PATH_INFO: `/v3/projects/1aadc9b01e9e4e55843bcc7403d4dd1c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.519355 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aadc9b01e9e4e55843bcc7403d4dd1c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.523255 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.662040 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aadc9b01e9e4e55843bcc7403d4dd1c', 'request_id': 'req-1207cbb5-a7e1-401b-a787-bd54933ef01b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.759005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aadc9b01e9e4e55843bcc7403d4dd1c', 'request_id': 'req-1207cbb5-a7e1-401b-a787-bd54933ef01b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.773699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aadc9b01e9e4e55843bcc7403d4dd1c', 'request_id': 'req-1207cbb5-a7e1-401b-a787-bd54933ef01b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.798273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] The token cache is being invalidate because project 1aadc9b01e9e4e55843bcc7403d4dd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:40.798820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.799881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.802606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1286/2554] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:40 2022] DELETE /identity/v3/projects/1aadc9b01e9e4e55843bcc7403d4dd1c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:40.809008 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.825955 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d73f6-152f-4ad9-a0d2-6d17ce7ad23e service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.920028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.920028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.920028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.920028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] PATH_INFO: `/v3/users/1c8210c9059b4b39acd7878f22a657d3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.921330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8210c9059b4b39acd7878f22a657d3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.923634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.185245 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8210c9059b4b39acd7878f22a657d3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.210408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8210c9059b4b39acd7878f22a657d3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.211776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8210c9059b4b39acd7878f22a657d3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.357573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8210c9059b4b39acd7878f22a657d3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.366175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-452b0802-4564-4526-86ca-f0e7f9b54757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8210c9059b4b39acd7878f22a657d3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.373395 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1269/2555] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:40 2022] DELETE /identity/v3/users/1c8210c9059b4b39acd7878f22a657d3 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:41.921971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.923987 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.940665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cbb5-a7e1-401b-a787-bd54933ef01b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.037068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.037750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.038028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.038300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] PATH_INFO: `/v3/projects/a509d144700c45739d59848c59bc3fd6` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.039559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a509d144700c45739d59848c59bc3fd6)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.042020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.168708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:42.170235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a509d144700c45739d59848c59bc3fd6', 'request_id': 'req-c5a26b98-169e-451f-88f3-1d61117d52b4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.243928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a509d144700c45739d59848c59bc3fd6', 'request_id': 'req-c5a26b98-169e-451f-88f3-1d61117d52b4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.252373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a509d144700c45739d59848c59bc3fd6', 'request_id': 'req-c5a26b98-169e-451f-88f3-1d61117d52b4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.265060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] The token cache is being invalidate because project a509d144700c45739d59848c59bc3fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:42.265425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.266049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5a26b98-169e-451f-88f3-1d61117d52b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.267600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1287/2556] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:41 2022] DELETE /identity/v3/projects/a509d144700c45739d59848c59bc3fd6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:42.272960 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.273760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.274329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.435376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:42.436662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.495998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:42.529333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1270/2557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:42.538250 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.538863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.542996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.563207 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:42.564358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.575546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1288/2558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:42.578277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.590315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7c9f-5553-4336-9fa1-4de9a1aa02fe None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.616898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.617809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.621717 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.622006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.622752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:42.623110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.624696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.648926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1271/2559] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:46:42.653608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.665140 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db905-d10b-47c2-8360-a7562f590289 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.671654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.673689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.674266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.674789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.676542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.679672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.884889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1289/2560] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:42 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:42.889868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.901124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a719ee-06e1-4b56-b5bb-af5aa6c918c2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.976529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.977565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.979366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.979798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.980827 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.986759 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.106261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1272/2561] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:42 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:43.110824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.122553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566a8d-0a82-4e27-a542-1723ffac3f9a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.127742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.128386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.128837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.129119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.129811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:43.131527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.143839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1290/2562] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:43.152009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.163429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317d64b-df0e-4f55-91ae-b92ea7517636 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.171364 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478abd8-67ee-4a56-b8e8-dbd3b7db4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.177389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478abd8-67ee-4a56-b8e8-dbd3b7db4b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.177389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478abd8-67ee-4a56-b8e8-dbd3b7db4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.177389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478abd8-67ee-4a56-b8e8-dbd3b7db4b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.177389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478abd8-67ee-4a56-b8e8-dbd3b7db4b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:43.177389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478abd8-67ee-4a56-b8e8-dbd3b7db4b62 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.190522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1273/2563] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:43.195162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.208994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a099-846c-4022-8dd8-90d1deefaf1d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.220805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.223581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.224071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.224561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] PATH_INFO: `/v3/projects/71ffd6d196614441845a83ffbe355087/users/9a7432f71f1a4e7c88838af096fabad3/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.256186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ffd6d196614441845a83ffbe355087, user_id=9a7432f71f1a4e7c88838af096fabad3, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:43.261947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.372477 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1291/2564] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:43 2022] PUT /identity/v3/projects/71ffd6d196614441845a83ffbe355087/users/9a7432f71f1a4e7c88838af096fabad3/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:43.392713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.395039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.396350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.433429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] MFA Rules not processed for user `9a7432f71f1a4e7c88838af096fabad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:43.435664 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:43.587689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1274/2565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:43.595419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.789398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842293e-72ae-4af5-9c1e-064b9df18558 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.805483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.805483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.805483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.805483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.806046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:43.827084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.973150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1292/2566] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:43 2022] POST /identity/v3/projects => generated 375 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:43.981614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.001116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9da97-7f09-454e-b08a-416c52d475b9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.062555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:44.115744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.117043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.118536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.118536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.120284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.124318 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.238790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1275/2567] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:43 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:44.243792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.269001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e4c4-134f-4e23-bb7c-a8d5514c63e9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.281113 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.282107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.282580 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.282989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.283957 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.286647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.303908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1293/2568] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:44.314822 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.332707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49c2b5-e2ac-4341-89bd-29dfc0f3e346 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.344120 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.344883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.345315 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.345947 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] PATH_INFO: `/v3/projects/f9a77bce4ec74af69fb9fc4ab639a96c/users/69e298ea9afd4986a518df6c39c43035/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.374932 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a77bce4ec74af69fb9fc4ab639a96c, user_id=69e298ea9afd4986a518df6c39c43035, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.377757 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.476875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1276/2569] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:44 2022] PUT /identity/v3/projects/f9a77bce4ec74af69fb9fc4ab639a96c/users/69e298ea9afd4986a518df6c39c43035/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:44.482099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.500001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1e81-818f-469a-9284-dbcc206c2ee0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.571628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:44.592341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d10567-7094-4178-8e0a-b1f280e9060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.606796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d10567-7094-4178-8e0a-b1f280e9060c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.607497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d10567-7094-4178-8e0a-b1f280e9060c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.607785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d10567-7094-4178-8e0a-b1f280e9060c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.609384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d10567-7094-4178-8e0a-b1f280e9060c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.611275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d10567-7094-4178-8e0a-b1f280e9060c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.623694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1294/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:44.632495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.646589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369b419-d8f4-4852-b7ca-3f8b56e1a685 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.652570 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.653426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.653811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.654192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] PATH_INFO: `/v3/projects/f9a77bce4ec74af69fb9fc4ab639a96c/users/69e298ea9afd4986a518df6c39c43035/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.656836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a77bce4ec74af69fb9fc4ab639a96c, user_id=69e298ea9afd4986a518df6c39c43035, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.660392 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.675546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1277/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:44 2022] PUT /identity/v3/projects/f9a77bce4ec74af69fb9fc4ab639a96c/users/69e298ea9afd4986a518df6c39c43035/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:44.687278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.687564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.687964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.745364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] MFA Rules not processed for user `69e298ea9afd4986a518df6c39c43035`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:44.747059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:44.861893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1295/2572] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:44.930908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.930908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.027800 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23086-7e1b-4b53-a220-607a509b9dfd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:45.032106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69809255-26c4-44ed-bcd3-edd6599321db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:45.032769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809255-26c4-44ed-bcd3-edd6599321db service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.033099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809255-26c4-44ed-bcd3-edd6599321db service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.033438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809255-26c4-44ed-bcd3-edd6599321db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.141719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69809255-26c4-44ed-bcd3-edd6599321db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:45.145350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69809255-26c4-44ed-bcd3-edd6599321db service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.160097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1278/2573] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:49.108587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.221321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1dccd-a06b-428d-bc7f-629a497f457d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.226150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.227015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.227191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.227400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] PATH_INFO: `/v3/users/9a7432f71f1a4e7c88838af096fabad3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.228691 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7432f71f1a4e7c88838af096fabad3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.230934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.563066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7432f71f1a4e7c88838af096fabad3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.563692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7432f71f1a4e7c88838af096fabad3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.577595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7432f71f1a4e7c88838af096fabad3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.581598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.671969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7432f71f1a4e7c88838af096fabad3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.672605 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7432f71f1a4e7c88838af096fabad3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.687264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1296/2574] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:49 2022] DELETE /identity/v3/users/9a7432f71f1a4e7c88838af096fabad3 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:49.692504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.692504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.693070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.714604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:49.715895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.760524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.785586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1279/2575] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:49.796406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.798657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.862352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd666-54e7-449f-afb1-7a0bf832f145 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.866294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.866943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.867221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.867491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.881539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.883369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.897027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1297/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:50.369472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.380420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a4536-ec51-4286-88d9-b0c7ef33bc1e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.384332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02134235-4d91-4509-9049-a69097368406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.385482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02134235-4d91-4509-9049-a69097368406 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.385812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02134235-4d91-4509-9049-a69097368406 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.386268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02134235-4d91-4509-9049-a69097368406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.391176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-02134235-4d91-4509-9049-a69097368406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:50.397943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.400024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:50.417281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02134235-4d91-4509-9049-a69097368406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.420191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02134235-4d91-4509-9049-a69097368406 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.421770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4f43-23dc-4181-a1a9-4859e0121d42 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.427394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.427996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.428513 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.428811 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] PATH_INFO: `/v3/projects/71ffd6d196614441845a83ffbe355087` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.430109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ffd6d196614441845a83ffbe355087)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.433190 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1280/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:50.435294 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.559175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ffd6d196614441845a83ffbe355087', 'request_id': 'req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.680009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ffd6d196614441845a83ffbe355087', 'request_id': 'req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.687657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ffd6d196614441845a83ffbe355087', 'request_id': 'req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.701646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] The token cache is being invalidate because project 71ffd6d196614441845a83ffbe355087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:50.702223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.703520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.705213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1298/2578] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:50 2022] DELETE /identity/v3/projects/71ffd6d196614441845a83ffbe355087 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:50.711297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02134235-4d91-4509-9049-a69097368406 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.723638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02134235-4d91-4509-9049-a69097368406 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.827869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.831177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:50.855530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.856565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.856855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.857226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] PATH_INFO: `/v3/users/69e298ea9afd4986a518df6c39c43035` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.858440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e298ea9afd4986a518df6c39c43035)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.860828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.953170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd75a-4931-4f3e-bcfb-a24ba36634db admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.961283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.962400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.963352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.963858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] PATH_INFO: `/v3/users/ab37d3e9e91d48d3b3d022effc2a2a43` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.966029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab37d3e9e91d48d3b3d022effc2a2a43)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.969746 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.988805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.200035 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e298ea9afd4986a518df6c39c43035'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.229273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e298ea9afd4986a518df6c39c43035'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.229273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e298ea9afd4986a518df6c39c43035'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.272941 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab37d3e9e91d48d3b3d022effc2a2a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.273702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab37d3e9e91d48d3b3d022effc2a2a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.289852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab37d3e9e91d48d3b3d022effc2a2a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.317999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e298ea9afd4986a518df6c39c43035'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.330464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7aee0c12-bea1-4532-acf8-b68eb2cd56d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e298ea9afd4986a518df6c39c43035'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.340163 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1281/2579] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:50 2022] DELETE /identity/v3/users/69e298ea9afd4986a518df6c39c43035 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:51.445887 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab37d3e9e91d48d3b3d022effc2a2a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.446889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab37d3e9e91d48d3b3d022effc2a2a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.473686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1299/2580] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:50 2022] DELETE /identity/v3/users/ab37d3e9e91d48d3b3d022effc2a2a43 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:51.482021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485806-0029-4218-901c-771dc6e41d8b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.482681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485806-0029-4218-901c-771dc6e41d8b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.483263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485806-0029-4218-901c-771dc6e41d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.515537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-44485806-0029-4218-901c-771dc6e41d8b None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:51.517082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-44485806-0029-4218-901c-771dc6e41d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.578766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.601472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1282/2581] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:51.609880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.616009 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.761105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c337-aa9e-43cc-baee-6295e81eed9e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.767150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cca84-acb2-45f9-aa2f-ec3473010415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.769677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cca84-acb2-45f9-aa2f-ec3473010415 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.769677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cca84-acb2-45f9-aa2f-ec3473010415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.769677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cca84-acb2-45f9-aa2f-ec3473010415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.782313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cca84-acb2-45f9-aa2f-ec3473010415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.783970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cca84-acb2-45f9-aa2f-ec3473010415 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.796894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1300/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:51.866616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485806-0029-4218-901c-771dc6e41d8b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.868303 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-44485806-0029-4218-901c-771dc6e41d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.886785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485806-0029-4218-901c-771dc6e41d8b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.892207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.892867 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.893165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.893487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] PATH_INFO: `/v3/projects/f9a77bce4ec74af69fb9fc4ab639a96c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.895366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a77bce4ec74af69fb9fc4ab639a96c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.897367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.062733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a77bce4ec74af69fb9fc4ab639a96c', 'request_id': 'req-412438af-78f2-4869-a529-c1dfc909f083'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:52.154940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a77bce4ec74af69fb9fc4ab639a96c', 'request_id': 'req-412438af-78f2-4869-a529-c1dfc909f083'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:52.163852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a77bce4ec74af69fb9fc4ab639a96c', 'request_id': 'req-412438af-78f2-4869-a529-c1dfc909f083'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:52.177135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] The token cache is being invalidate because project f9a77bce4ec74af69fb9fc4ab639a96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:52.177503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:52.178166 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-412438af-78f2-4869-a529-c1dfc909f083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:52.179811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1283/2583] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:51 2022] DELETE /identity/v3/projects/f9a77bce4ec74af69fb9fc4ab639a96c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:52.187014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.188010 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.193917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.216607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:52.217884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.296493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1301/2584] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:52.305405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.305773 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.306183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.333122 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:52.334273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.350008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.351216 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1284/2585] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:52.362812 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f523971-4fa0-4f53-b422-216d40cbd39d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.387539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:52.390920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.391399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.406024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1302/2586] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:52.413223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.423542 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a6724-6d96-4cc5-ba24-95346be1f6a6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.428316 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.428924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.429202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.429476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.430113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.432804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.592030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1285/2587] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:52.598425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.626904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf27b-bcbb-477b-a43e-da2d26ffc24c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.660489 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:52.725829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.726971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.727252 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.727531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.729122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.730864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.899719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1303/2588] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:52 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:52.904779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.907261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.908587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.939871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd247-6178-4889-81a1-86f7c715840e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.950635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b4e2-b434-4a69-801f-1d27695c8ab5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.961917 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.962467 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.963597 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.964090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.964607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] PATH_INFO: `/v3/projects/37108ddbd8a840b3a8fd751ed03ea313` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.966134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.966447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.966787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.967541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.968021 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37108ddbd8a840b3a8fd751ed03ea313)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.969786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.972872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.995945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1304/2589] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:52.995945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.011193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fdbf5-546f-421e-b392-840c0993598d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.017124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.018079 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.018378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.018666 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.019707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.021398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.046405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1305/2590] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:53.057664 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.089349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e5f4-f80d-4a88-8bc9-63f67ab9ac69 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.100224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595422f5-4f30-4b92-abce-d8b156c50b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.101785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595422f5-4f30-4b92-abce-d8b156c50b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.111156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595422f5-4f30-4b92-abce-d8b156c50b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.111156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595422f5-4f30-4b92-abce-d8b156c50b59 admin admin] PATH_INFO: `/v3/projects/e7641ccb811449cd8ac4c61f9f581d9a/users/49767d62abe947e5a3407a719f0d0dc1/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.162466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595422f5-4f30-4b92-abce-d8b156c50b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7641ccb811449cd8ac4c61f9f581d9a, user_id=49767d62abe947e5a3407a719f0d0dc1, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.168459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595422f5-4f30-4b92-abce-d8b156c50b59 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.189134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37108ddbd8a840b3a8fd751ed03ea313', 'request_id': 'req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.312175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1306/2591] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:53 2022] PUT /identity/v3/projects/e7641ccb811449cd8ac4c61f9f581d9a/users/49767d62abe947e5a3407a719f0d0dc1/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:53.315800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.316070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.316370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.325814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37108ddbd8a840b3a8fd751ed03ea313', 'request_id': 'req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.334744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37108ddbd8a840b3a8fd751ed03ea313', 'request_id': 'req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.350166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:53.352323 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.378092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] The token cache is being invalidate because project 37108ddbd8a840b3a8fd751ed03ea313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:53.378969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.380005 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.383842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1286/2592] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:52 2022] DELETE /identity/v3/projects/37108ddbd8a840b3a8fd751ed03ea313 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:53.391557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.395291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.460463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1307/2593] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:53.469315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.471891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:53.472201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.549153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac21c4-ee04-4c2a-b5b1-a9234ca3d466 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.554401 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.555191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.555603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.565709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] PATH_INFO: `/v3/users/f4074f96276e4ff0b0d1e8c5272fe83f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.565709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4074f96276e4ff0b0d1e8c5272fe83f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.565709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.576286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5de71-6705-4f2e-a25d-06f8c2ca44be None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.589297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.589939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.594213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.594421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.610374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.612482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.627069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1308/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:53.836118 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4074f96276e4ff0b0d1e8c5272fe83f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.861056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4074f96276e4ff0b0d1e8c5272fe83f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.862255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4074f96276e4ff0b0d1e8c5272fe83f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.964265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4074f96276e4ff0b0d1e8c5272fe83f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.973530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-56a58e5b-ed8a-4cf9-b10e-9a472b3ee023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4074f96276e4ff0b0d1e8c5272fe83f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.991430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1287/2595] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:53 2022] DELETE /identity/v3/users/f4074f96276e4ff0b0d1e8c5272fe83f => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:54.513086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.525317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f829-569b-4038-8a1a-0088c7536f95 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.533869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.643718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.645836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.651363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.651363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] PATH_INFO: `/v3/projects/e4fd0e12dd1449048d0e1fef86c73d5e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.651363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fd0e12dd1449048d0e1fef86c73d5e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.651363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.887926 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fd0e12dd1449048d0e1fef86c73d5e', 'request_id': 'req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.975360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fd0e12dd1449048d0e1fef86c73d5e', 'request_id': 'req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.987964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fd0e12dd1449048d0e1fef86c73d5e', 'request_id': 'req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.002302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] The token cache is being invalidate because project e4fd0e12dd1449048d0e1fef86c73d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:55.002615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.004116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e8bf5ae9-2ea2-4572-91c9-e211396ac6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.005723 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1309/2596] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:54 2022] DELETE /identity/v3/projects/e4fd0e12dd1449048d0e1fef86c73d5e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:55.013909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.014481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.014667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.063902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:55.066013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:55.261282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1288/2597] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:55.278291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.278809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.279096 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.317084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:55.324856 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:55.336331 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1310/2598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:55.344333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:55.354284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220eb9-7282-4e76-a64e-ab91d75840e9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.359099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.359914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.360372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.360795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.362933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:55.363413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.377352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.390935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1289/2599] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:55.401427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:55.410786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280e77-8c64-4889-9e22-53ec19a74d2a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.420170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.421212 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.421878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.422346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.427742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.431174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.563197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1311/2600] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:55 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:55.567662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:55.579991 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3682d9-4e8b-4564-8770-ad6f01e8a531 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.645817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:55.712382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c7afc-46c2-4ed1-944a-ed3b1062f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.713952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7afc-46c2-4ed1-944a-ed3b1062f82a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.714442 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7afc-46c2-4ed1-944a-ed3b1062f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.715006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7afc-46c2-4ed1-944a-ed3b1062f82a admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.716220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c7afc-46c2-4ed1-944a-ed3b1062f82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.720299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c7afc-46c2-4ed1-944a-ed3b1062f82a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.825177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1290/2601] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:55 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:55.833128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:55.861610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991fc0-76e6-49a6-aa8a-a1cdf26700db admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.870645 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.871982 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.872708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.873166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.874482 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.874655 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.875020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.875443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.890898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.930292 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1312/2602] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:55.937439 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:55.942832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] MFA Rules not processed for user `49767d62abe947e5a3407a719f0d0dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:55.951171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:55.976563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e65ea2-3943-4b6b-b842-d67a55b4a9f5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.984133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.985019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.985332 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.985609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.986502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.988946 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.018099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1313/2603] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:56.024006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.037397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306a71-e468-49f9-8ab7-3d1e52207d25 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.043076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d385c-e24b-4833-bb15-52acb37da9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.043992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d385c-e24b-4833-bb15-52acb37da9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.044116 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d385c-e24b-4833-bb15-52acb37da9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.044457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d385c-e24b-4833-bb15-52acb37da9f7 admin admin] PATH_INFO: `/v3/projects/11bfed65b5aa486f942890430657106c/users/0282f38644c24e12910fae84f2dd2c63/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.063212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1291/2604] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:56.066631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d385c-e24b-4833-bb15-52acb37da9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bfed65b5aa486f942890430657106c, user_id=0282f38644c24e12910fae84f2dd2c63, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.069440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d385c-e24b-4833-bb15-52acb37da9f7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.076208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.077686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.158355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f610c51-ef23-446c-aec1-2d2ce75e3408 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.162762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.163503 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.163858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.164204 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.179227 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.181992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.199403 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1292/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:56.200680 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.208594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.209922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1314/2606] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:56 2022] PUT /identity/v3/projects/11bfed65b5aa486f942890430657106c/users/0282f38644c24e12910fae84f2dd2c63/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:56.217792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.218078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.218344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.230366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c119-3eca-4152-9b89-85313af7bbcf service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.257555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] MFA Rules not processed for user `0282f38644c24e12910fae84f2dd2c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.257555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.273911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:56.329599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.330611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.334528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.334528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] PATH_INFO: `/v3/users/fbc1fd78028a4b1c91b7ff29ecd4b6f5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.334528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc1fd78028a4b1c91b7ff29ecd4b6f5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.336112 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.363917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1315/2607] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:56.366150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.380281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f1796-ac45-4849-aa4d-45d221dda07f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.386797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.387466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.387750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.388023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.388668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.390637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.505640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1316/2608] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:56.514731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.601379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed63e6-42f3-4a4d-8555-69e008df6655 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.614231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc1fd78028a4b1c91b7ff29ecd4b6f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.616604 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.617550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.618059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.618729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.620002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.622321 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.641070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc1fd78028a4b1c91b7ff29ecd4b6f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.642173 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc1fd78028a4b1c91b7ff29ecd4b6f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.734716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc1fd78028a4b1c91b7ff29ecd4b6f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.743093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1317/2609] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/users => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:56.747866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc1fd78028a4b1c91b7ff29ecd4b6f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.749341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.751747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.759705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1293/2610] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:56 2022] DELETE /identity/v3/users/fbc1fd78028a4b1c91b7ff29ecd4b6f5 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:56.766042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:56.773442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d260b3-4bfc-4eb5-b5c9-c3f0bb5ad02d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.860717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.861586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.861586 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.861872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.862532 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.864235 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.883401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1318/2611] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:56.886266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.908517 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16e48-5c76-4f80-b47c-6a8813d37d55 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.915787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.916505 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.916836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.917055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] PATH_INFO: `/v3/projects/3c866372484d4515adc2edf765ed9152/users/7c1fce6af8484f24ae26839e535ac0f1/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.936663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c866372484d4515adc2edf765ed9152, user_id=7c1fce6af8484f24ae26839e535ac0f1, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.938408 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.040609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1294/2612] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:56 2022] PUT /identity/v3/projects/3c866372484d4515adc2edf765ed9152/users/7c1fce6af8484f24ae26839e535ac0f1/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.044512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.075609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd988110-4e3b-4420-9148-1b36f7c852de admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.097135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.149076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.151892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.164710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.165261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.166109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.166420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.167148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.168813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.195499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1319/2613] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:57.197345 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.213365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8480-9119-4c07-9fa3-b6166f9a3f59 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.218922 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3bb4f-8084-4098-9e27-c99092202fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.219827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3bb4f-8084-4098-9e27-c99092202fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.220258 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3bb4f-8084-4098-9e27-c99092202fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.220706 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3bb4f-8084-4098-9e27-c99092202fe7 admin admin] PATH_INFO: `/v3/projects/3c866372484d4515adc2edf765ed9152/users/7c1fce6af8484f24ae26839e535ac0f1/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.222906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3bb4f-8084-4098-9e27-c99092202fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c866372484d4515adc2edf765ed9152, user_id=7c1fce6af8484f24ae26839e535ac0f1, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.226037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3bb4f-8084-4098-9e27-c99092202fe7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.261553 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1320/2614] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:57 2022] PUT /identity/v3/projects/3c866372484d4515adc2edf765ed9152/users/7c1fce6af8484f24ae26839e535ac0f1/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.270199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a096c-bb7f-4dd9-9550-491595a4b052 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.275455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.275455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.275455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.310426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] MFA Rules not processed for user `7c1fce6af8484f24ae26839e535ac0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:57.311697 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.341898 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.350312 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.351460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.351744 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.352359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] PATH_INFO: `/v3/projects/048fc05529024faa9aa4605e8f404271` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.354890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] RBAC: Authorizing `identity:delete_project(project_id=048fc05529024faa9aa4605e8f404271)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.356675 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.404179 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1321/2615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:57.416721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.418279 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.486033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679093-0d33-4a54-bdd0-9c7a9e4ee29a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.489800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.490416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.490727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.490983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.501176 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.502686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.514188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1322/2616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:57.575807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048fc05529024faa9aa4605e8f404271', 'request_id': 'req-1488a66f-d0de-442c-8ebd-fcff0f4c367a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:57.678719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.691296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84c02d-7754-4bff-85f3-540ae5998ffb service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.703116 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048fc05529024faa9aa4605e8f404271', 'request_id': 'req-1488a66f-d0de-442c-8ebd-fcff0f4c367a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:57.712085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048fc05529024faa9aa4605e8f404271', 'request_id': 'req-1488a66f-d0de-442c-8ebd-fcff0f4c367a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:57.726662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] The token cache is being invalidate because project 048fc05529024faa9aa4605e8f404271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:57.726990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:57.727677 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1488a66f-d0de-442c-8ebd-fcff0f4c367a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:57.730314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1295/2617] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:57 2022] DELETE /identity/v3/projects/048fc05529024faa9aa4605e8f404271 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.736128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7e845-02aa-480f-8c50-fd370ee25a4c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.736359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7e845-02aa-480f-8c50-fd370ee25a4c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.736540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7e845-02aa-480f-8c50-fd370ee25a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.759999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cdc7e845-02aa-480f-8c50-fd370ee25a4c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:57.761426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cdc7e845-02aa-480f-8c50-fd370ee25a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.772627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.773190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.773602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.773901 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] PATH_INFO: `/v3/users/0282f38644c24e12910fae84f2dd2c63` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.775778 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0282f38644c24e12910fae84f2dd2c63)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.777846 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.817393 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.837213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1296/2618] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:57.848445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.848809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.849119 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.869472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:57.870979 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.879635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1297/2619] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:57.884905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.895678 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117aec0-e199-4203-b4f1-ffdf183319f3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.902407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.903099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.903444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.909797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.909797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:57.909797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.909797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.921195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1298/2620] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:46:57.926203 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.936779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddf5ae-b953-4e6c-a6f4-be05bfd912d8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.941565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.942207 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.942497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.943672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.943672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.945299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.011251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0282f38644c24e12910fae84f2dd2c63'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.012053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0282f38644c24e12910fae84f2dd2c63'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.024783 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0282f38644c24e12910fae84f2dd2c63'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.105864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1299/2621] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:58.110764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.152531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0282f38644c24e12910fae84f2dd2c63'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.153965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d3139a0-d123-4d4f-a934-47d16d61fd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0282f38644c24e12910fae84f2dd2c63'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.192419 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1323/2622] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:57 2022] DELETE /identity/v3/users/0282f38644c24e12910fae84f2dd2c63 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:58.198725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ac93-cfee-48ea-b5ab-affe63103d30 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.198725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ac93-cfee-48ea-b5ab-affe63103d30 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.198725 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ac93-cfee-48ea-b5ab-affe63103d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.210580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8449b-ecd7-45e2-b85c-06a66b159cd4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.222968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-db51ac93-cfee-48ea-b5ab-affe63103d30 None None] MFA Rules not processed for user `49767d62abe947e5a3407a719f0d0dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:58.224998 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-db51ac93-cfee-48ea-b5ab-affe63103d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.293144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.293144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.293144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.293144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.293806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.293806 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.301479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1324/2623] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:58.301479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b132eb0-8904-482a-8289-33437e31608c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.301479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b132eb0-8904-482a-8289-33437e31608c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.301479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b132eb0-8904-482a-8289-33437e31608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.323967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8b132eb0-8904-482a-8289-33437e31608c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:58.325211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b132eb0-8904-482a-8289-33437e31608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.333458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1325/2624] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:58.348894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b132eb0-8904-482a-8289-33437e31608c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.351329 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b132eb0-8904-482a-8289-33437e31608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.374918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:58.415373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1300/2625] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:58 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:58.417446 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.419326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.421291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b132eb0-8904-482a-8289-33437e31608c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.425347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.425979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.426256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.426523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.433825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604986d-a48b-4b6e-b744-3483f3696a76 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.439155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.439939 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.440325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.440719 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.441479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.443461 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.446035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.448146 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.456957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1301/2626] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:58.474990 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1326/2627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:58.480193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.497839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868dcc-e55f-487a-bb82-118478441e02 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.503769 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ad1c2-00f9-4e97-ac42-50a89bcc274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.504507 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad1c2-00f9-4e97-ac42-50a89bcc274b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.504829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad1c2-00f9-4e97-ac42-50a89bcc274b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.505181 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad1c2-00f9-4e97-ac42-50a89bcc274b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.505903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ad1c2-00f9-4e97-ac42-50a89bcc274b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.508097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ad1c2-00f9-4e97-ac42-50a89bcc274b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.521984 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1302/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:58.528335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.540517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d223-7504-4e68-9a54-1e540266a418 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.551314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.551314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.551314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.551314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] PATH_INFO: `/v3/projects/df20bc83bda44c23bd3c1fbd83dd990e/users/91a2268e60654240bbfd6a0e3b4febaf/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.568883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df20bc83bda44c23bd3c1fbd83dd990e, user_id=91a2268e60654240bbfd6a0e3b4febaf, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.571904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.641869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:58.727585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1327/2629] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:58 2022] PUT /identity/v3/projects/df20bc83bda44c23bd3c1fbd83dd990e/users/91a2268e60654240bbfd6a0e3b4febaf/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:58.739429 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.739720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.740005 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.784872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] MFA Rules not processed for user `91a2268e60654240bbfd6a0e3b4febaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:58.786164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.892372 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1303/2630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:58.910184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.912373 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.032635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ee9e-29b1-4112-9040-1879646298d2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.040358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.041650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.042135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.042679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.052919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.054592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.072311 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1328/2631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:59.187056 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.188380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.296604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:59.314844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069548b-305d-414e-99fa-b31bb955d4ee None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.325721 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.327365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.327365 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.327734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] PATH_INFO: `/v3/projects/11bfed65b5aa486f942890430657106c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.329189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bfed65b5aa486f942890430657106c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.339760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.497978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bfed65b5aa486f942890430657106c', 'request_id': 'req-bb6cb183-2438-4d81-a29b-6f95ef367df0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.596731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bfed65b5aa486f942890430657106c', 'request_id': 'req-bb6cb183-2438-4d81-a29b-6f95ef367df0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.605341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bfed65b5aa486f942890430657106c', 'request_id': 'req-bb6cb183-2438-4d81-a29b-6f95ef367df0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.621390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] The token cache is being invalidate because project 11bfed65b5aa486f942890430657106c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:59.621390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.622210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.623881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1304/2632] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:59 2022] DELETE /identity/v3/projects/11bfed65b5aa486f942890430657106c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:59.628755 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.639997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db45aa-15df-4d2c-8c2e-30a4e96e5aab service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.724700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.725417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.725716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.725988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] PATH_INFO: `/v3/users/7c1fce6af8484f24ae26839e535ac0f1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.727195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1fce6af8484f24ae26839e535ac0f1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.730013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.977177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1fce6af8484f24ae26839e535ac0f1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.977177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1fce6af8484f24ae26839e535ac0f1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.990668 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:00.005803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1fce6af8484f24ae26839e535ac0f1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:00.091213 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1fce6af8484f24ae26839e535ac0f1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:00.092432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87ea2e92-dfd7-4af1-a641-2706ef13d8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1fce6af8484f24ae26839e535ac0f1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:00.109319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1329/2633] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:59 2022] DELETE /identity/v3/users/7c1fce6af8484f24ae26839e535ac0f1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:00.746157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.751253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:00.768683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb183-2438-4d81-a29b-6f95ef367df0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.849370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.850025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.850333 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.850607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] PATH_INFO: `/v3/projects/3c866372484d4515adc2edf765ed9152` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.851873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c866372484d4515adc2edf765ed9152)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.854418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.051754 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c866372484d4515adc2edf765ed9152', 'request_id': 'req-3560099d-93e1-4ba9-a230-5a48edeaa599'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.125449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c866372484d4515adc2edf765ed9152', 'request_id': 'req-3560099d-93e1-4ba9-a230-5a48edeaa599'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.134852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c866372484d4515adc2edf765ed9152', 'request_id': 'req-3560099d-93e1-4ba9-a230-5a48edeaa599'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.161740 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] The token cache is being invalidate because project 3c866372484d4515adc2edf765ed9152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:01.162295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.163893 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3560099d-93e1-4ba9-a230-5a48edeaa599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.167617 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1305/2634] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:00 2022] DELETE /identity/v3/projects/3c866372484d4515adc2edf765ed9152 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:01.175871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.176644 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.177056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.213758 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:01.215262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:01.319026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1330/2635] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:01.328350 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.329031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.329780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.360588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:01.362143 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:01.372785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1306/2636] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:01.378539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.395049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b806c-9e40-4f41-8545-178c6d1707aa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.404050 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.404884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.405065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.405238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.406070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:01.406432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.409394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.438753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1331/2637] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:01.442422 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.455502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:01.462925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760558b0-28d8-422a-8b60-63ead8f8e46c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.468994 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.469656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.469925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.470202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.471346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.473371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.641847 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1307/2638] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:01 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:01.650264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.676426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314845c-9517-4ef7-84ff-248c82a16e7e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.771484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.772507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.772936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.773231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.773875 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.777218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.911109 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1332/2639] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:01 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:01.915579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.929818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e025e-e7be-4d59-a123-e69d7e0ae395 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.936352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.936641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.936887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.937160 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.937828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.941039 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.954013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1308/2640] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:01.960293 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.977942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f243c-94e9-4c46-a258-98cf8adae5ff admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.983155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf3e13-3798-442d-95f1-2d70603568ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.983801 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3e13-3798-442d-95f1-2d70603568ce admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.984091 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3e13-3798-442d-95f1-2d70603568ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.984370 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3e13-3798-442d-95f1-2d70603568ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.985066 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf3e13-3798-442d-95f1-2d70603568ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.986965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf3e13-3798-442d-95f1-2d70603568ce admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.005858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1333/2641] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:02.019586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:02.044978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f254c-787a-478b-b9f8-f7294ad46fd4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.061872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:02.064905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.064905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.064905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] PATH_INFO: `/v3/projects/104cd821d81a48d5aaf1df6d641d298e/users/e6c2e4a79c1e44f99615e525b232e8af/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.095888 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104cd821d81a48d5aaf1df6d641d298e, user_id=e6c2e4a79c1e44f99615e525b232e8af, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:02.100157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.216057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1309/2642] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:02 2022] PUT /identity/v3/projects/104cd821d81a48d5aaf1df6d641d298e/users/e6c2e4a79c1e44f99615e525b232e8af/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:02.230972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.233163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.233163 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.274937 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] MFA Rules not processed for user `e6c2e4a79c1e44f99615e525b232e8af`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:02.276569 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:02.312487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:02.392988 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1334/2643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:02.398161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:02.507037 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dfa9a-09fe-49ea-af3f-ed5b75ddeef6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.514602 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:02.515377 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.515698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.515986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.516699 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:02.519088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.699137 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1310/2644] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:02 2022] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:02.700162 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:02.722765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805704f-1cd3-4592-8d12-c0422b4920b0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.835192 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:02.842099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.842099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.842099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.842099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:02.842099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.967695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1335/2645] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:02 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:02.972713 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:02.991048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb372fb0-ed49-4a51-bc7f-05d764a18f3c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.999378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.002641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.002641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.002641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.003101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.005781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.021023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1311/2646] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:03.027159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.039303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3d61-6fae-4456-a2c4-23cc0760dbfa admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.045033 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.045727 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.046006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.046278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] PATH_INFO: `/v3/projects/f017c5b46634435b9477daa614330abb/users/862153fc553747d7b5d6e7e00e90da9b/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.067366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f017c5b46634435b9477daa614330abb, user_id=862153fc553747d7b5d6e7e00e90da9b, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.070171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.220195 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1336/2647] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:03 2022] PUT /identity/v3/projects/f017c5b46634435b9477daa614330abb/users/862153fc553747d7b5d6e7e00e90da9b/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:03.238594 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.253268 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439953-0e7b-4222-8586-42d37c919a82 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.339896 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d1403-8d17-4edd-aaf0-c0a2cd4abaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.340515 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d1403-8d17-4edd-aaf0-c0a2cd4abaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.340798 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d1403-8d17-4edd-aaf0-c0a2cd4abaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.341071 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d1403-8d17-4edd-aaf0-c0a2cd4abaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.341871 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d1403-8d17-4edd-aaf0-c0a2cd4abaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.343547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d1403-8d17-4edd-aaf0-c0a2cd4abaf8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.360710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1312/2648] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:03.362548 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.378022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc578460-6656-4b9e-9a7d-26e62b1a7463 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.383541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.384364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.384673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.385189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] PATH_INFO: `/v3/projects/f017c5b46634435b9477daa614330abb/users/862153fc553747d7b5d6e7e00e90da9b/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.387800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f017c5b46634435b9477daa614330abb, user_id=862153fc553747d7b5d6e7e00e90da9b, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.390472 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.406976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1337/2649] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:03 2022] PUT /identity/v3/projects/f017c5b46634435b9477daa614330abb/users/862153fc553747d7b5d6e7e00e90da9b/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:03.427040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.427538 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.428032 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.478180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] MFA Rules not processed for user `862153fc553747d7b5d6e7e00e90da9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:03.480885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.489762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:03.573022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1313/2650] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:03.584480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.586300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.710989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f6fc3-71d7-4f07-823f-d156fef30c39 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.716208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef5db-b5f7-4e21-a4cd-20ef9b576021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.716849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef5db-b5f7-4e21-a4cd-20ef9b576021 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.717170 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef5db-b5f7-4e21-a4cd-20ef9b576021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.717445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef5db-b5f7-4e21-a4cd-20ef9b576021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.729631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef5db-b5f7-4e21-a4cd-20ef9b576021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.731180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef5db-b5f7-4e21-a4cd-20ef9b576021 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.742647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1338/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:04.602608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.706628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ddb4-8c38-4157-9446-e5fec2112cf1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.712383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.713100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.713369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.713645 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] PATH_INFO: `/v3/users/e6c2e4a79c1e44f99615e525b232e8af` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.715109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c2e4a79c1e44f99615e525b232e8af)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.717106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.986799 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c2e4a79c1e44f99615e525b232e8af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:05.015518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c2e4a79c1e44f99615e525b232e8af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:05.016547 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c2e4a79c1e44f99615e525b232e8af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:05.142263 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c2e4a79c1e44f99615e525b232e8af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:05.157944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c2e4a79c1e44f99615e525b232e8af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:05.166654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1314/2652] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:04 2022] DELETE /identity/v3/users/e6c2e4a79c1e44f99615e525b232e8af => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:05.171720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:05.173761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:05.174251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:05.329980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:05.331492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:05.347587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:05.406367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1339/2653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:05.418626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:05.421934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:05.458382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:05.493000 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c113230-7b89-4b61-8e20-5ab7d24e7f4b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:05.497390 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:05.498015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:05.498393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:05.498663 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:05.508544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:05.510861 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:05.523531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1315/2654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:06.029214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:06.029945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:06.051537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf32158-7a10-4796-a09f-f488e6fd71ce None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:06.059688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:06.059688 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:06.060459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:06.060459 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] PATH_INFO: `/v3/projects/104cd821d81a48d5aaf1df6d641d298e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:06.062994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=104cd821d81a48d5aaf1df6d641d298e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:06.063973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:06.200779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:06.200779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:06.214287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443208-11da-48e2-9fa5-b966880bf32c service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:06.218970 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:06.219599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:06.219906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:06.220184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] PATH_INFO: `/v3/users/91a2268e60654240bbfd6a0e3b4febaf` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:06.221358 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a2268e60654240bbfd6a0e3b4febaf)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:06.223313 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:06.262134 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104cd821d81a48d5aaf1df6d641d298e', 'request_id': 'req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.483735 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104cd821d81a48d5aaf1df6d641d298e', 'request_id': 'req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.491015 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104cd821d81a48d5aaf1df6d641d298e', 'request_id': 'req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.504265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] The token cache is being invalidate because project 104cd821d81a48d5aaf1df6d641d298e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:06.504559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.505253 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.506815 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1340/2655] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:06 2022] DELETE /identity/v3/projects/104cd821d81a48d5aaf1df6d641d298e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:06.511761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:06.513292 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:06.584805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54efc4-f5d4-44b3-bdaf-c2680ef439bf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:06.590316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:06.590560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a2268e60654240bbfd6a0e3b4febaf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.591019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:06.591353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:06.591628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] PATH_INFO: `/v3/users/862153fc553747d7b5d6e7e00e90da9b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:06.592829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862153fc553747d7b5d6e7e00e90da9b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:06.594917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:06.607669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a2268e60654240bbfd6a0e3b4febaf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.608426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a2268e60654240bbfd6a0e3b4febaf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.713983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a2268e60654240bbfd6a0e3b4febaf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.729496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8a22af17-76f2-4bdb-9692-e9b13faaf0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a2268e60654240bbfd6a0e3b4febaf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.736748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1316/2656] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:06 2022] DELETE /identity/v3/users/91a2268e60654240bbfd6a0e3b4febaf => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:06.741157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:06.741441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:06.741715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:06.762753 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:06.763986 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:06.829329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1317/2657] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:06.839403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:06.840809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:06.841490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862153fc553747d7b5d6e7e00e90da9b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.842164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862153fc553747d7b5d6e7e00e90da9b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.842291 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:06.856919 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862153fc553747d7b5d6e7e00e90da9b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.888145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:06.905993 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc33a5-2933-4f6b-9d3f-29e708471a47 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:06.911298 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:06.912257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:06.912553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:06.912887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:06.924274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:06.925696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:06.928843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862153fc553747d7b5d6e7e00e90da9b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.929649 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862153fc553747d7b5d6e7e00e90da9b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:06.936720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1318/2658] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:06.944769 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1341/2659] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:06 2022] DELETE /identity/v3/users/862153fc553747d7b5d6e7e00e90da9b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:07.622843 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:07.624541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:07.640980 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e400a8-a003-4786-8eae-7ecf1570cbc5 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:07.660450 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:07.662433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:07.759040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:07.760687 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:07.761077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:07.761416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] PATH_INFO: `/v3/projects/f017c5b46634435b9477daa614330abb` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:07.763255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f017c5b46634435b9477daa614330abb)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:07.766413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:07.787020 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83f5a-9306-45b6-b1db-8b098dfce706 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:07.794876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:07.795651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:07.796137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:07.800898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] PATH_INFO: `/v3/projects/df20bc83bda44c23bd3c1fbd83dd990e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:07.800898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df20bc83bda44c23bd3c1fbd83dd990e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:07.802297 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:07.983648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f017c5b46634435b9477daa614330abb', 'request_id': 'req-0a3feff9-1f87-4edf-95e8-62bb15999486'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:07.984328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df20bc83bda44c23bd3c1fbd83dd990e', 'request_id': 'req-612331c7-cef4-4de0-92b2-b5cdcbc88c57'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.096573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df20bc83bda44c23bd3c1fbd83dd990e', 'request_id': 'req-612331c7-cef4-4de0-92b2-b5cdcbc88c57'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.104940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df20bc83bda44c23bd3c1fbd83dd990e', 'request_id': 'req-612331c7-cef4-4de0-92b2-b5cdcbc88c57'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.115782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] The token cache is being invalidate because project df20bc83bda44c23bd3c1fbd83dd990e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:08.116073 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.116718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-612331c7-cef4-4de0-92b2-b5cdcbc88c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.118199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1342/2660] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:07 2022] DELETE /identity/v3/projects/df20bc83bda44c23bd3c1fbd83dd990e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:08.123122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208365-737b-40db-a3dd-492c3759004d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.123495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208365-737b-40db-a3dd-492c3759004d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.123825 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208365-737b-40db-a3dd-492c3759004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.145081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-08208365-737b-40db-a3dd-492c3759004d None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:08.146335 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-08208365-737b-40db-a3dd-492c3759004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.200853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:08.214133 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1343/2661] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:08.222521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f017c5b46634435b9477daa614330abb', 'request_id': 'req-0a3feff9-1f87-4edf-95e8-62bb15999486'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.223326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.223626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.223907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.233647 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f017c5b46634435b9477daa614330abb', 'request_id': 'req-0a3feff9-1f87-4edf-95e8-62bb15999486'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.246174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:08.246909 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] The token cache is being invalidate because project f017c5b46634435b9477daa614330abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:08.247209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.247785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.248292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0a3feff9-1f87-4edf-95e8-62bb15999486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.249998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1319/2662] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:07 2022] DELETE /identity/v3/projects/f017c5b46634435b9477daa614330abb => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:08.254539 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172e04-73da-4859-9e1d-a9ec32dfd39a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.255085 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172e04-73da-4859-9e1d-a9ec32dfd39a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.255519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172e04-73da-4859-9e1d-a9ec32dfd39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.260006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1344/2663] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:08.261892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.274936 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7192bcb-cdf7-4673-b5db-7885cd765f11 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.283246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.284022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.284334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.284853 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.285610 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:08.285905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.288159 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.301523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7a172e04-73da-4859-9e1d-a9ec32dfd39a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:08.308127 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7a172e04-73da-4859-9e1d-a9ec32dfd39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.308300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1345/2664] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:08.312366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1320/2665] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:08.312810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.325083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905197ec-e722-43b2-a61b-17e13aba5c49 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.326136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.326726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.327159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.331022 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.332177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.332177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.332177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.332859 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.334828 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.353406 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:08.356061 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.367493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1321/2666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:08.372284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.381565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d729e-04cf-400d-b96c-bc9bc0d4967e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.387526 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.388148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.388426 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.388696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.389359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:08.389661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.391324 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.413924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1322/2667] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:47:08.418805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.430178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c63c4-b5d0-42a8-a9d2-94e2062bec3e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.436045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.436805 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.437175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.437544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.438430 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.440669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.550866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1346/2668] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:08.559632 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.614448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1323/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:08.618610 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.630618 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583a89-a75c-4dd4-8bb8-cabb6389f965 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.653378 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:08.708779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.709261 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072153-c514-42c4-9d5c-936206494c16 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.725353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.725353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.725353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.725353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.725353 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.726351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.726351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.726351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.726351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.726748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.726748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.895341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1347/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/users => generated 284 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:08.895581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1324/2671] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:08.899603 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.901228 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.924139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7ccf-dc21-4f4c-a3ec-8366b5a1cabf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.932290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97992-a96d-468b-89b5-26443c52491c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.941607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.942832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.943449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.944067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.944891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.946280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.946589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.947416 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.948944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.950949 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.956043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.964792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1348/2672] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:08.965470 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.978104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.990976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38f8c-b262-4435-8f99-1a031979bbc9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.995615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1325/2673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:08.999438 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.001772 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.003205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.003709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.004190 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.005339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.008546 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.028719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1349/2674] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:09.034572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bd833-eebf-411a-8379-d60cc30d1629 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.034743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.041356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.042043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.042329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.042601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.043398 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.045417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.055788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7591d8-4e8e-4d47-9e7f-4cf3be970531 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.061296 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1326/2675] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:09.065199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.065789 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10550a-217a-4d71-8df5-954657cc5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.066608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10550a-217a-4d71-8df5-954657cc5995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.066983 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10550a-217a-4d71-8df5-954657cc5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.067322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10550a-217a-4d71-8df5-954657cc5995 admin admin] PATH_INFO: `/v3/projects/6925bd051f494bf6a18dde14d19f8940/users/7971f293fb604bb5913a0dedece04df4/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.076908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b449-33d6-491a-a828-f106939ff6b9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.083755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce03088-0f76-4831-bfa5-b9dc90999702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.084439 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03088-0f76-4831-bfa5-b9dc90999702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.084724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03088-0f76-4831-bfa5-b9dc90999702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.085029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03088-0f76-4831-bfa5-b9dc90999702 admin admin] PATH_INFO: `/v3/projects/325aaa66474a45ef99734658a1dda42e/users/f3a80cf84fb548ebb9be0ee598e56a2c/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.086598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10550a-217a-4d71-8df5-954657cc5995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6925bd051f494bf6a18dde14d19f8940, user_id=7971f293fb604bb5913a0dedece04df4, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.090383 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10550a-217a-4d71-8df5-954657cc5995 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.104210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03088-0f76-4831-bfa5-b9dc90999702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325aaa66474a45ef99734658a1dda42e, user_id=f3a80cf84fb548ebb9be0ee598e56a2c, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.107277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03088-0f76-4831-bfa5-b9dc90999702 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.167962 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1350/2676] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:09 2022] PUT /identity/v3/projects/6925bd051f494bf6a18dde14d19f8940/users/7971f293fb604bb5913a0dedece04df4/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:09.186540 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.187104 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.187574 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.217709 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1327/2677] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:09 2022] PUT /identity/v3/projects/325aaa66474a45ef99734658a1dda42e/users/f3a80cf84fb548ebb9be0ee598e56a2c/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:09.227977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.229150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.229288 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.231631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] MFA Rules not processed for user `7971f293fb604bb5913a0dedece04df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:09.232945 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.261741 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] MFA Rules not processed for user `f3a80cf84fb548ebb9be0ee598e56a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:09.263031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.306160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1351/2678] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:09.318722 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.320263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.336688 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1328/2679] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:09.349540 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.351553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.391634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f257a5-3409-4784-90aa-0d7f7aa4860c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.395897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.396518 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.396799 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.397072 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.406185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.407996 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.417174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1352/2680] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:09.424105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f0606-6e3f-4aa8-8d3a-b3ff487e4911 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.428884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788829c9-27df-47eb-855d-5b1850b2a2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.429868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788829c9-27df-47eb-855d-5b1850b2a2bc service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.430407 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788829c9-27df-47eb-855d-5b1850b2a2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.430839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788829c9-27df-47eb-855d-5b1850b2a2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.443074 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788829c9-27df-47eb-855d-5b1850b2a2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.444823 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788829c9-27df-47eb-855d-5b1850b2a2bc service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.457357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1329/2681] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:09.484970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.574851 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d382c6-c40b-48e8-8b13-38477d14fb00 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.582177 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.583008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.583352 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.583616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] PATH_INFO: `/v3/users/f3a80cf84fb548ebb9be0ee598e56a2c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.585229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a80cf84fb548ebb9be0ee598e56a2c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.587281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.818925 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a80cf84fb548ebb9be0ee598e56a2c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.819602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a80cf84fb548ebb9be0ee598e56a2c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.833729 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a80cf84fb548ebb9be0ee598e56a2c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.905470 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a80cf84fb548ebb9be0ee598e56a2c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.906199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a80cf84fb548ebb9be0ee598e56a2c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.919377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1353/2682] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:09 2022] DELETE /identity/v3/users/f3a80cf84fb548ebb9be0ee598e56a2c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:09.923990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.924490 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.924590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.944376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:09.945595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:10.018153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:10.043002 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1330/2683] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:10.055436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:10.057059 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:10.131495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb574-b378-4a3d-bb23-00b41edc6b84 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:10.144327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa964dc-0e48-4df6-bad4-8952d2d230d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:10.146043 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa964dc-0e48-4df6-bad4-8952d2d230d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:10.146527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa964dc-0e48-4df6-bad4-8952d2d230d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:10.146646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa964dc-0e48-4df6-bad4-8952d2d230d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:10.165313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa964dc-0e48-4df6-bad4-8952d2d230d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:10.166876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa964dc-0e48-4df6-bad4-8952d2d230d6 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:10.179458 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1354/2684] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:10.417196 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:10.764100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:10.765636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:10.787755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd2f87-cc50-405a-8692-c7a81a1cf10f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:10.816250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:10.816250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:10.816250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:10.816250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] PATH_INFO: `/v3/projects/325aaa66474a45ef99734658a1dda42e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:10.819182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325aaa66474a45ef99734658a1dda42e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:10.821354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:10.978975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325aaa66474a45ef99734658a1dda42e', 'request_id': 'req-5e2b9fa7-50bd-4644-8657-7352ddbeb849'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.097092 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325aaa66474a45ef99734658a1dda42e', 'request_id': 'req-5e2b9fa7-50bd-4644-8657-7352ddbeb849'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.103886 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325aaa66474a45ef99734658a1dda42e', 'request_id': 'req-5e2b9fa7-50bd-4644-8657-7352ddbeb849'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.115019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] The token cache is being invalidate because project 325aaa66474a45ef99734658a1dda42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:11.115289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.116423 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e2b9fa7-50bd-4644-8657-7352ddbeb849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.119133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1331/2685] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:10 2022] DELETE /identity/v3/projects/325aaa66474a45ef99734658a1dda42e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:11.125057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.125617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.125617 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.148286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:11.149510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:11.226478 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1355/2686] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:11.237279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.239138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.239469 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.277938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:11.278737 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:11.297445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1332/2687] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:11.302817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.314720 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4a99-babc-45fb-9a92-744981dd3c21 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.319973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.320695 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.321001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.321366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.322205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:11.322364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.324899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.343770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1356/2688] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:11.348606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.361492 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39730e-6cce-4cd5-9c49-dc823754af87 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.370762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.372502 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.379105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.379105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.379105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.379105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.488051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1333/2689] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:11 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:11.492428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.503910 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50102-73e6-4c08-9853-02d619a418b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.572429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.572958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.573237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.573642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.574944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.577006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.712745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1357/2690] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:11 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:11.717445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.728385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffc013-111d-4968-ace2-7d6f8e27aa7d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.733274 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.733884 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.734162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.734434 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.735171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.736790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.752641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1334/2691] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:11.757526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.771596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287529b-83cb-47cb-9c72-4bca4dd58b3f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.777037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f22ca-8030-4ea3-ad50-2b621af6fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.777768 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f22ca-8030-4ea3-ad50-2b621af6fc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.778060 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f22ca-8030-4ea3-ad50-2b621af6fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.778440 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f22ca-8030-4ea3-ad50-2b621af6fc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.780150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f22ca-8030-4ea3-ad50-2b621af6fc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.780966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f22ca-8030-4ea3-ad50-2b621af6fc1b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.792599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1358/2692] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:11.797153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.807895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5ce1-a230-45a4-8340-dbac2963133d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.813338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.814009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.814289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.814564 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] PATH_INFO: `/v3/projects/1d537caaa6a94a6f8f18cfa04929f2cf/users/00665c26b4804108abc53eec73debe7b/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.834674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d537caaa6a94a6f8f18cfa04929f2cf, user_id=00665c26b4804108abc53eec73debe7b, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.837750 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.018097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1335/2693] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:11 2022] PUT /identity/v3/projects/1d537caaa6a94a6f8f18cfa04929f2cf/users/00665c26b4804108abc53eec73debe7b/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:12.030092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.030806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.031448 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.072527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] MFA Rules not processed for user `00665c26b4804108abc53eec73debe7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:12.075533 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:12.156661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1359/2694] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:12.161473 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:12.249985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd707783-d5c2-4097-90f2-f283aa59bb71 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:12.255930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:12.256659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.256833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.257109 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.263553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:12.265482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.448937 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1336/2695] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:12 2022] POST /identity/v3/projects => generated 383 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:12.452525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:12.463827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed521-7e60-4d40-827f-e9d8e33e3784 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:12.519713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:12.536124 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:12.536740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.537019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.537287 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.537917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:12.539864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.681129 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1360/2696] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:12 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:12.685102 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:12.696177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc45a4d-6620-426c-97e7-bda2413b48c2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:12.702138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:12.702895 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.703180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.703456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.704153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:12.705813 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.719938 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1337/2697] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:12.724677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:12.737616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494b5a-347b-4fa6-aaa8-3ec89f4aa588 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:12.742396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5499c-1a80-46d9-9d6e-a8ecbb2f7eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:12.743028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5499c-1a80-46d9-9d6e-a8ecbb2f7eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.743307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5499c-1a80-46d9-9d6e-a8ecbb2f7eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.743578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5499c-1a80-46d9-9d6e-a8ecbb2f7eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.744269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5499c-1a80-46d9-9d6e-a8ecbb2f7eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:12.746343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5499c-1a80-46d9-9d6e-a8ecbb2f7eb3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.757461 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1361/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:12.763215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:12.773755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e57c1-03c3-473c-8494-2f5a34d02eb9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:12.779479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:12.780149 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.780428 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.780735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] PATH_INFO: `/v3/projects/e07c341ff9d9418b9c7779e0375719c5/users/cc0809b2b5354b50827562aa2485eec7/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.797045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07c341ff9d9418b9c7779e0375719c5, user_id=cc0809b2b5354b50827562aa2485eec7, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:12.799864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.963551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1338/2699] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:12 2022] PUT /identity/v3/projects/e07c341ff9d9418b9c7779e0375719c5/users/cc0809b2b5354b50827562aa2485eec7/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:12.975238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.975525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.975800 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.007502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] MFA Rules not processed for user `cc0809b2b5354b50827562aa2485eec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:13.008747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:13.076831 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1362/2700] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:13.084338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:13.121543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:13.152900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07fd61-826a-4e8a-91c6-91443c03aa17 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:13.159144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:13.159779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:13.160756 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:13.161009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.161658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:13.163631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:13.327130 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1339/2701] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:13 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:13.329485 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:13.347494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5255-814b-4480-9191-9cb954a419b6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:13.431229 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:13.431985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:13.432326 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:13.432739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.434340 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:13.436636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:13.560341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1363/2702] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:13 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:13.561518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:13.571845 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ef87e-fd0f-4c1c-8501-6800c5c80a3d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:13.577349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:13.577978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:13.578253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:13.578522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.579221 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:13.580852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:13.593251 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1340/2703] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:13.598186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:13.611187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d4ab9-6b3f-4a0e-a228-ebb1eec884fd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:13.617262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:13.623933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:13.623933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:13.623933 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] PATH_INFO: `/v3/projects/7edd954e916c489b9d642ebd0c4260ec/users/9ff6d8dc060e4ab5945f85117b5389c4/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.638979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edd954e916c489b9d642ebd0c4260ec, user_id=9ff6d8dc060e4ab5945f85117b5389c4, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:13.641690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:13.811037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1364/2704] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:13 2022] PUT /identity/v3/projects/7edd954e916c489b9d642ebd0c4260ec/users/9ff6d8dc060e4ab5945f85117b5389c4/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:13.815666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:13.834494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b64565-6aba-4fcd-8cab-28cdaef4e3cb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:13.906682 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8cf0-44e1-4ad4-9458-f21cbc2f7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:13.907084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8cf0-44e1-4ad4-9458-f21cbc2f7593 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:13.907393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8cf0-44e1-4ad4-9458-f21cbc2f7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:13.907764 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8cf0-44e1-4ad4-9458-f21cbc2f7593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.908560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8cf0-44e1-4ad4-9458-f21cbc2f7593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:13.910366 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8cf0-44e1-4ad4-9458-f21cbc2f7593 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:13.923648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1341/2705] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:13.938969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:13.956457 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60fcf7-1798-4388-9631-652446020379 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:13.962126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:13.962866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:13.963150 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:13.963420 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] PATH_INFO: `/v3/projects/7edd954e916c489b9d642ebd0c4260ec/users/9ff6d8dc060e4ab5945f85117b5389c4/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:13.965521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edd954e916c489b9d642ebd0c4260ec, user_id=9ff6d8dc060e4ab5945f85117b5389c4, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:13.968291 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:13.979963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1365/2706] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:13 2022] PUT /identity/v3/projects/7edd954e916c489b9d642ebd0c4260ec/users/9ff6d8dc060e4ab5945f85117b5389c4/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:14.055887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:14.055887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:14.056236 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:14.090922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] MFA Rules not processed for user `9ff6d8dc060e4ab5945f85117b5389c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:14.092222 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:14.185541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1342/2707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:14.284315 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:14.286555 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:14.378392 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8f851-848b-405e-a98a-a058406ef640 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:14.383264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e54a02-a0b5-463b-b335-4bf9db57d1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:14.383907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54a02-a0b5-463b-b335-4bf9db57d1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:14.384184 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54a02-a0b5-463b-b335-4bf9db57d1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:14.384454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54a02-a0b5-463b-b335-4bf9db57d1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:14.474733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e54a02-a0b5-463b-b335-4bf9db57d1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:14.476208 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e54a02-a0b5-463b-b335-4bf9db57d1b2 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:14.487417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1366/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:14.904945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:14.906724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:14.968248 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:15.112454 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fde36-5198-4afe-97b4-5d3357d64b17 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:15.114934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:15.115614 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:15.115899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:15.116167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] PATH_INFO: `/v3/users/e73c9517bc8b44d9acf7403ce46327c8` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:15.117479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73c9517bc8b44d9acf7403ce46327c8)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:15.119495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:15.444883 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73c9517bc8b44d9acf7403ce46327c8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:15.460819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73c9517bc8b44d9acf7403ce46327c8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:15.461705 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73c9517bc8b44d9acf7403ce46327c8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:15.570828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73c9517bc8b44d9acf7403ce46327c8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:15.582031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73c9517bc8b44d9acf7403ce46327c8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:15.589063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1343/2709] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:14 2022] DELETE /identity/v3/users/e73c9517bc8b44d9acf7403ce46327c8 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:15.595135 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:15.595904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:15.595904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:15.634964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:15.637636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:15.745158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1367/2710] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:15.755656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:15.757555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:15.852083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b2f8-b42a-4477-82c7-d8f41fa07b2b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:15.859672 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:15.860321 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:15.860606 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:15.860882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:15.871882 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:15.873360 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:15.885019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1344/2711] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:16.028052 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:16.517780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:16.521034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:16.549186 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcab89-9f5e-49a7-9873-d4f537826488 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:16.554028 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:16.554679 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:16.554994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:16.555265 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] PATH_INFO: `/v3/projects/ae54e46d39e643da9e84738137fae04d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:16.556432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae54e46d39e643da9e84738137fae04d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:16.559049 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:16.721441 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae54e46d39e643da9e84738137fae04d', 'request_id': 'req-4888b71d-bd5d-44db-acf6-76b0766e009b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:16.799587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae54e46d39e643da9e84738137fae04d', 'request_id': 'req-4888b71d-bd5d-44db-acf6-76b0766e009b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:16.814566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae54e46d39e643da9e84738137fae04d', 'request_id': 'req-4888b71d-bd5d-44db-acf6-76b0766e009b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:16.850444 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] The token cache is being invalidate because project ae54e46d39e643da9e84738137fae04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:16.862653 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:16.862839 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:16.863285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:16.863369 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:16.863464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1368/2712] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:16 2022] DELETE /identity/v3/projects/ae54e46d39e643da9e84738137fae04d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:16.951703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b168a-ce3a-4c39-a9aa-08f4e9112380 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:16.986594 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:17.020229 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:17.020969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:17.021477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:17.021819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:17.024009 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:17.121273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:17.172828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:17.174964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:17.189164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1345/2713] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:17.423208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:17.627350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:19.409628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:19.411273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:19.425980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888b71d-bd5d-44db-acf6-76b0766e009b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:19.429902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:19.430519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:19.430826 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:19.431099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:19.432928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:19.487980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:19.521647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:19.523347 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6bfae-ab2d-48c7-8c89-39e4760bd74b service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:19.537566 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1369/2714] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:21.553323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:21.555220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:21.640379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b2b-26e6-4820-aea3-9362b03f0240 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:21.645752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:21.646413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:21.646729 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:21.646992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] PATH_INFO: `/v3/users/7971f293fb604bb5913a0dedece04df4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:21.648301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7971f293fb604bb5913a0dedece04df4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:21.650306 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:21.908711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7971f293fb604bb5913a0dedece04df4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.928870 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7971f293fb604bb5913a0dedece04df4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.929631 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7971f293fb604bb5913a0dedece04df4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.022393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7971f293fb604bb5913a0dedece04df4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.033290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7971f293fb604bb5913a0dedece04df4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.037416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:22.040514 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1346/2715] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:21 2022] DELETE /identity/v3/users/7971f293fb604bb5913a0dedece04df4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:22.045517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:22.046038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:22.046158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:22.066547 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:22.067821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:22.132346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1370/2716] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:22.143964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:22.145770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:22.213534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661aa2-9cde-4546-a0a2-345809d1730d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:22.218188 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b5ba9-dfbe-4be1-910b-17280eff7c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:22.218858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b5ba9-dfbe-4be1-910b-17280eff7c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:22.219148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b5ba9-dfbe-4be1-910b-17280eff7c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:22.219443 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b5ba9-dfbe-4be1-910b-17280eff7c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:22.229711 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b5ba9-dfbe-4be1-910b-17280eff7c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:22.231583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b5ba9-dfbe-4be1-910b-17280eff7c2f service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:22.242176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1347/2717] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:22.903703 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:22.907975 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:22.943395 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7b25e-4573-4ab1-8f68-59fbfabd2f9e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:22.954274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:22.954274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:22.954274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:22.954274 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] PATH_INFO: `/v3/projects/6925bd051f494bf6a18dde14d19f8940` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:22.955112 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6925bd051f494bf6a18dde14d19f8940)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:22.955550 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.097037 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6925bd051f494bf6a18dde14d19f8940', 'request_id': 'req-dc3d0308-78aa-4f3e-ba57-8557cebc196d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.225879 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6925bd051f494bf6a18dde14d19f8940', 'request_id': 'req-dc3d0308-78aa-4f3e-ba57-8557cebc196d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.234148 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6925bd051f494bf6a18dde14d19f8940', 'request_id': 'req-dc3d0308-78aa-4f3e-ba57-8557cebc196d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.248608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] The token cache is being invalidate because project 6925bd051f494bf6a18dde14d19f8940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:23.248884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.249600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-dc3d0308-78aa-4f3e-ba57-8557cebc196d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.251168 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1371/2718] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:22 2022] DELETE /identity/v3/projects/6925bd051f494bf6a18dde14d19f8940 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:23.256551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.261702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.261702 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.315922 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:23.317758 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.398732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1348/2719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:23.411736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.411736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.411736 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.437770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:23.439067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.447784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1372/2720] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:23.453017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.473553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5aa49-569c-4c46-9eb8-c9b260f79fc9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.482985 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.484107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.484611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.485128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.486436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:23.487060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.490367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.513965 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1349/2721] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:23.526407 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.538044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5b9c4-7965-47b6-ba7b-9220fbc00518 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.544517 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.545254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.545599 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.546044 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.546974 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.549074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.681977 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1373/2722] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:23.689475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.700660 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52991-6025-4e01-b8fb-2eee6b1661fa admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.775265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.775265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.775595 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.777299 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.777930 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.781460 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.795354 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:23.938525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1350/2723] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:23.944950 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.959141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ee29a-2d12-4150-a73f-7c35d231f96c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.965056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.965685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.965965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.966398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.967065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.968852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.981556 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1374/2724] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:23.986072 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.997022 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f28b29-e4f9-4204-9e3d-3bc45ba12862 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.002289 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bf587-33d2-4388-a749-e510e51646d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.002962 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf587-33d2-4388-a749-e510e51646d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.003370 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf587-33d2-4388-a749-e510e51646d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.003523 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf587-33d2-4388-a749-e510e51646d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.004170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bf587-33d2-4388-a749-e510e51646d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.005815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bf587-33d2-4388-a749-e510e51646d0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.023067 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1351/2725] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:24.029806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.048672 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab22ab-6934-4856-bf71-d832b00ec259 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.053847 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.054534 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.054845 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.055127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] PATH_INFO: `/v3/projects/2b2cb903a58243639d088ecd57b1be10/users/2d36d587962e4134aa609ecdc5e585c9/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.073798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2cb903a58243639d088ecd57b1be10, user_id=2d36d587962e4134aa609ecdc5e585c9, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.076963 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.216024 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:24.226759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1375/2726] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:24 2022] PUT /identity/v3/projects/2b2cb903a58243639d088ecd57b1be10/users/2d36d587962e4134aa609ecdc5e585c9/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:24.241501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.241852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.242090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.272765 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] MFA Rules not processed for user `2d36d587962e4134aa609ecdc5e585c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:24.273992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.344148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1352/2727] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:24.358877 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.359322 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.495965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5795-6d6e-452d-b9b1-10310e77338b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.501797 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.504545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.504545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.504545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.512260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.513852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.523750 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1376/2728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:24.794323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.875506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e7997-c6bb-4f57-bb6b-4e230f9c5737 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.881103 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.881782 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.882057 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.882332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] PATH_INFO: `/v3/users/2d36d587962e4134aa609ecdc5e585c9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.884391 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d36d587962e4134aa609ecdc5e585c9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.887329 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.944181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.946536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.962197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660dc5-9802-4359-a225-70d4e4e4d980 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.968456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.969143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.969426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.969702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] PATH_INFO: `/v3/users/00665c26b4804108abc53eec73debe7b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.971000 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00665c26b4804108abc53eec73debe7b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.972929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:25.125041 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d36d587962e4134aa609ecdc5e585c9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.142277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d36d587962e4134aa609ecdc5e585c9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.143170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d36d587962e4134aa609ecdc5e585c9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.258493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d36d587962e4134aa609ecdc5e585c9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.261998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:25.271302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6228de56-c3cb-4bf1-ae86-65d521276ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d36d587962e4134aa609ecdc5e585c9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.280820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00665c26b4804108abc53eec73debe7b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.281803 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00665c26b4804108abc53eec73debe7b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.282310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1353/2729] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:24 2022] DELETE /identity/v3/users/2d36d587962e4134aa609ecdc5e585c9 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:25.288323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:25.288599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:25.288881 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:25.299425 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00665c26b4804108abc53eec73debe7b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.311294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:25.312549 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:25.376560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1354/2730] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:25.387346 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:25.389017 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:25.431280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00665c26b4804108abc53eec73debe7b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.431930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c3877ae5-f3b3-4f92-8e0f-b4b0b9a75cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00665c26b4804108abc53eec73debe7b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:25.449502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1377/2731] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:24 2022] DELETE /identity/v3/users/00665c26b4804108abc53eec73debe7b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:25.454609 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:25.455498 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:25.455772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:25.460255 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54091f2-c8c2-477c-ada3-c9c4ca218ca6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:25.478774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:25.479521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:25.506432 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:25.520892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:25.521528 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:25.521814 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:25.522096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:25.523988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:25.562619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1378/2732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:25.572921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:25.575717 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:25.590023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a5ed8-86df-437a-a077-269c19a75383 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:25.594314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:25.594973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:25.595406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:25.595864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:25.599275 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:25.600828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:25.613967 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1355/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:25.614788 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:25.617093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:25.634857 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1379/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:25.698045 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:26.157224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.158873 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.172763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866956-f451-4b99-9c09-f5d610eaab34 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:26.178621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:26.179317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.179624 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.179901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] PATH_INFO: `/v3/projects/2b2cb903a58243639d088ecd57b1be10` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.181192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2cb903a58243639d088ecd57b1be10)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:26.183357 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:26.215772 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.217866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.235588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909f912-2523-4e4b-bb17-5152374af947 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:26.240487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:26.241136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.241415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.241689 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] PATH_INFO: `/v3/projects/1d537caaa6a94a6f8f18cfa04929f2cf` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.243254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d537caaa6a94a6f8f18cfa04929f2cf)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:26.245083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:26.379656 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2cb903a58243639d088ecd57b1be10', 'request_id': 'req-1ccc9165-876a-4a1e-87f3-d34273da0438'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.428153 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d537caaa6a94a6f8f18cfa04929f2cf', 'request_id': 'req-7bb839ea-04a0-4967-86a2-db0753583c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.507998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2cb903a58243639d088ecd57b1be10', 'request_id': 'req-1ccc9165-876a-4a1e-87f3-d34273da0438'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.517107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2cb903a58243639d088ecd57b1be10', 'request_id': 'req-1ccc9165-876a-4a1e-87f3-d34273da0438'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.530201 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] The token cache is being invalidate because project 2b2cb903a58243639d088ecd57b1be10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:26.530494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.531244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1ccc9165-876a-4a1e-87f3-d34273da0438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.532807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1356/2735] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:26 2022] DELETE /identity/v3/projects/2b2cb903a58243639d088ecd57b1be10 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:26.537894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b71d8-d65d-4b85-b20f-b4224b6f2a27 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.538215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b71d8-d65d-4b85-b20f-b4224b6f2a27 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.538444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b71d8-d65d-4b85-b20f-b4224b6f2a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.559511 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2c7b71d8-d65d-4b85-b20f-b4224b6f2a27 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:26.560749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2c7b71d8-d65d-4b85-b20f-b4224b6f2a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.615016 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d537caaa6a94a6f8f18cfa04929f2cf', 'request_id': 'req-7bb839ea-04a0-4967-86a2-db0753583c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.622390 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d537caaa6a94a6f8f18cfa04929f2cf', 'request_id': 'req-7bb839ea-04a0-4967-86a2-db0753583c9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.629208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1357/2736] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:26.634602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] The token cache is being invalidate because project 1d537caaa6a94a6f8f18cfa04929f2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:26.634932 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.636344 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.637973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1380/2737] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:26 2022] DELETE /identity/v3/projects/1d537caaa6a94a6f8f18cfa04929f2cf => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:26.641029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.641029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.641029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.641897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.643427 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.657892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb839ea-04a0-4967-86a2-db0753583c9f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:26.660551 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:26.661775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.670480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:26.670480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.670480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.670480 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] PATH_INFO: `/v3/users/cc0809b2b5354b50827562aa2485eec7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.670959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0809b2b5354b50827562aa2485eec7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:26.670959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:26.674725 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1358/2738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:26.676371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.686730 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd382a5-5387-43eb-b8b8-670628ef207a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:26.697890 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:26.699134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.699413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.699838 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.700565 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:26.700868 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:26.703126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:26.719942 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1359/2739] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:26.721063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.734077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813def5f-6848-4aac-b68c-421c2b80f074 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:26.744858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:26.745833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.746115 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.746560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.747063 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:26.749170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:26.923219 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1360/2740] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:26 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:26.924431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.926417 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.952876 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0809b2b5354b50827562aa2485eec7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.953593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0809b2b5354b50827562aa2485eec7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.972394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0809b2b5354b50827562aa2485eec7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:26.983948 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:27.035777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6f6bb-04bd-4c7f-bbde-d139b31f369e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:27.041384 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:27.042050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.042376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.042718 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.044918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:27.058285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.060162 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.061905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0809b2b5354b50827562aa2485eec7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:27.062786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0809b2b5354b50827562aa2485eec7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:27.071476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1361/2741] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:27.081924 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:27.082030 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1381/2742] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:26 2022] DELETE /identity/v3/users/cc0809b2b5354b50827562aa2485eec7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:27.147679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc4e9-a276-4606-9ed0-e22cd70952f4 service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:27.228636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:27.229449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.229821 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.230184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.231064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.233136 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.466271 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1362/2743] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:27 2022] POST /identity/v3/users => generated 282 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:27.469447 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:27.470839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:27.486144 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce76be9-d182-4407-8c2b-e067b628a2c9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:27.491763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:27.492400 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.492667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.492939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.493597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.495917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.502806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:27.508215 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1382/2744] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:27.515208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:27.531862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a328-e8a1-41c8-940d-06fa08f2b65d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:27.538476 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:27.540148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.540148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.540148 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.541609 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.543735 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.559006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1363/2745] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:27.563670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:27.577452 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644aa4d-91d7-427c-98f1-0f0b5b5a65b5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:27.584752 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c97ae-a0e1-4134-ab1f-3085f92bf291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:27.585737 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c97ae-a0e1-4134-ab1f-3085f92bf291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.586187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c97ae-a0e1-4134-ab1f-3085f92bf291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.586655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c97ae-a0e1-4134-ab1f-3085f92bf291 admin admin] PATH_INFO: `/v3/projects/7b90ccdd698c49c3a97cdefbbc861a88/users/b37715b3c15e474cb3628f918ebe549d/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.610606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c97ae-a0e1-4134-ab1f-3085f92bf291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b90ccdd698c49c3a97cdefbbc861a88, user_id=b37715b3c15e474cb3628f918ebe549d, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.613378 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c97ae-a0e1-4134-ab1f-3085f92bf291 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.713156 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:27.723686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:27.736977 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920912-129e-4683-89f2-b1897b05e5cc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:27.743237 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:27.744169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.744654 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.745679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] PATH_INFO: `/v3/projects/e07c341ff9d9418b9c7779e0375719c5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.747812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07c341ff9d9418b9c7779e0375719c5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.752795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.762201 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1383/2746] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:27 2022] PUT /identity/v3/projects/7b90ccdd698c49c3a97cdefbbc861a88/users/b37715b3c15e474cb3628f918ebe549d/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:27.779014 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:27.779652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:27.780282 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:27.827850 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] MFA Rules not processed for user `b37715b3c15e474cb3628f918ebe549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:27.829445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:27.884783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:27.903062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07c341ff9d9418b9c7779e0375719c5', 'request_id': 'req-265a5a76-2eb4-4294-9731-3b030e798807'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:27.931057 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1384/2747] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:27.937531 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.020018 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07c341ff9d9418b9c7779e0375719c5', 'request_id': 'req-265a5a76-2eb4-4294-9731-3b030e798807'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.028744 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d94fdf-d9d3-45d1-ba53-6a7b38ff8294 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.033819 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07c341ff9d9418b9c7779e0375719c5', 'request_id': 'req-265a5a76-2eb4-4294-9731-3b030e798807'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.052294 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] The token cache is being invalidate because project e07c341ff9d9418b9c7779e0375719c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:28.052770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.053752 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.056402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1364/2748] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:27 2022] DELETE /identity/v3/projects/e07c341ff9d9418b9c7779e0375719c5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:28.061541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.063616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:28.125384 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.126349 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.126839 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.127292 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.128372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.131796 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.164529 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a5a76-2eb4-4294-9731-3b030e798807 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.171054 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.171788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.172230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.172679 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] PATH_INFO: `/v3/users/9ff6d8dc060e4ab5945f85117b5389c4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.174050 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff6d8dc060e4ab5945f85117b5389c4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.176496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.281260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:28.291584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1385/2749] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:27 2022] POST /identity/v3/projects => generated 365 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:28.298417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.299101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:28.374838 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d974-f5cd-4635-87c4-4abb827b4be9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.380904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.382198 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.382662 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.383185 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.384334 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.389381 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.543885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff6d8dc060e4ab5945f85117b5389c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.556010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff6d8dc060e4ab5945f85117b5389c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.556818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff6d8dc060e4ab5945f85117b5389c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.578120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1386/2750] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:28 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:28.582455 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.592499 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c87fb-197a-45bc-b8e9-953fb560bdd2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.597246 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.598026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.598264 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.598536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.599217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.600866 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.613537 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1387/2751] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:28.618189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.630003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0968-dcc5-4898-8668-28025acbb78e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.634911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.635759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.636748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.636997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] PATH_INFO: `/v3/projects/3536f5fcc82f461081952b1e32b7e8de/users/e135170e297549afa63d5fd7baffbc1a/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.652578 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3536f5fcc82f461081952b1e32b7e8de, user_id=e135170e297549afa63d5fd7baffbc1a, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.655251 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.679158 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff6d8dc060e4ab5945f85117b5389c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.688322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff6d8dc060e4ab5945f85117b5389c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.694907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1365/2752] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:28 2022] DELETE /identity/v3/users/9ff6d8dc060e4ab5945f85117b5389c4 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:28.800747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1388/2753] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:28 2022] PUT /identity/v3/projects/3536f5fcc82f461081952b1e32b7e8de/users/e135170e297549afa63d5fd7baffbc1a/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:28.805475 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.808661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:28.862914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:28.889405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b90110-b529-4acb-b4d1-3e459afea5e3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.961598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1410c-cb04-49fd-be97-777a61c72d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.962230 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1410c-cb04-49fd-be97-777a61c72d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.962510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1410c-cb04-49fd-be97-777a61c72d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.962812 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1410c-cb04-49fd-be97-777a61c72d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.963510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1410c-cb04-49fd-be97-777a61c72d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.965934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1410c-cb04-49fd-be97-777a61c72d3f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.977918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1366/2754] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:28.983749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.001692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8824-d654-40d7-8a42-ab8c729799bc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.010117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.011790 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.012386 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.012885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] PATH_INFO: `/v3/projects/3536f5fcc82f461081952b1e32b7e8de/users/e135170e297549afa63d5fd7baffbc1a/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.036003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3536f5fcc82f461081952b1e32b7e8de, user_id=e135170e297549afa63d5fd7baffbc1a, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:29.041456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:29.080377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1389/2755] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:28 2022] PUT /identity/v3/projects/3536f5fcc82f461081952b1e32b7e8de/users/e135170e297549afa63d5fd7baffbc1a/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:29.088516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.089359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.089860 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.143997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] MFA Rules not processed for user `e135170e297549afa63d5fd7baffbc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:29.147179 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.252749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1367/2756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:29.275715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.278573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.361094 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9097a2-5ed8-47af-8eec-45576c3a4144 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.365005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.365514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.365798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.366067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.377078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:29.378564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:29.390161 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1390/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:29.471202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.473497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.577956 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa412f-b8ae-48ad-a770-5e0889309ff4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.585040 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.585926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.586399 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.587780 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] PATH_INFO: `/v3/projects/7edd954e916c489b9d642ebd0c4260ec` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.589768 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7edd954e916c489b9d642ebd0c4260ec)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:29.592760 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:29.603541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:29.843568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7edd954e916c489b9d642ebd0c4260ec', 'request_id': 'req-fdd6ea38-7d24-4524-836d-9fd334a20c34'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.849600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.861595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502846c0-ea42-4e0c-a885-44a65b2f23c5 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.924507 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:29.941053 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.942031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.942509 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.943103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.946968 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.960785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7edd954e916c489b9d642ebd0c4260ec', 'request_id': 'req-fdd6ea38-7d24-4524-836d-9fd334a20c34'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.979394 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7edd954e916c489b9d642ebd0c4260ec', 'request_id': 'req-fdd6ea38-7d24-4524-836d-9fd334a20c34'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.999770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] The token cache is being invalidate because project 7edd954e916c489b9d642ebd0c4260ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:30.000285 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.001634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdd6ea38-7d24-4524-836d-9fd334a20c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.010277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1368/2758] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:29 2022] DELETE /identity/v3/projects/7edd954e916c489b9d642ebd0c4260ec => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:30.016931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81510e0-213d-41af-b778-62195eebf61c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.016931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81510e0-213d-41af-b778-62195eebf61c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.016931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81510e0-213d-41af-b778-62195eebf61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.060925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b81510e0-213d-41af-b778-62195eebf61c None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:30.063557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b81510e0-213d-41af-b778-62195eebf61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:30.102471 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.105188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe02438-61ea-4230-82ce-f66ce89d8f21 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.121966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1391/2759] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:30.181177 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1369/2760] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:30.192966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.193476 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.194445 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.230188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:30.232496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:30.246749 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1392/2761] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:30.260309 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81510e0-213d-41af-b778-62195eebf61c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.280086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81510e0-213d-41af-b778-62195eebf61c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.288208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.289151 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.289279 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.289508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.290210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:30.290555 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.292258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.306419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1370/2762] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:30.311514 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.322276 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51e681-99de-47a1-a1da-54fcd5aa111a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.328341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.328986 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.329275 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.329606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.330277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.332339 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.619141 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1393/2763] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/projects => generated 373 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:30.624464 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.636824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489348-a015-434b-8c34-6d64f1bf7162 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.723367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.724396 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.724874 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.725331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.726441 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.730433 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.836981 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1371/2764] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:30.847637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.857143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145ba5-82a7-439d-99b4-b750ebe1dca3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.862521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.863098 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.863374 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.863646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.864316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.866182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.878492 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1394/2765] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:30.883478 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.896726 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a602d-89d2-42d2-a3a3-f85b7894493e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.903090 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156165c7-dfcb-4417-a478-be746e1b5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.903710 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156165c7-dfcb-4417-a478-be746e1b5a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.904107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156165c7-dfcb-4417-a478-be746e1b5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.904453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156165c7-dfcb-4417-a478-be746e1b5a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.905393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156165c7-dfcb-4417-a478-be746e1b5a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.908481 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156165c7-dfcb-4417-a478-be746e1b5a02 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.925831 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1372/2766] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:30.931281 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.953173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdaec7-89aa-4e1e-9383-9ee2ecfda3e6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.961411 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.962651 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.963197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.964756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] PATH_INFO: `/v3/projects/b20d7200033a4555a3e8899c5972464f/users/8a5b65946dda474fa4a108efd71bfed4/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.994360 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20d7200033a4555a3e8899c5972464f, user_id=8a5b65946dda474fa4a108efd71bfed4, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.997429 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:31.174942 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1395/2767] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:30 2022] PUT /identity/v3/projects/b20d7200033a4555a3e8899c5972464f/users/8a5b65946dda474fa4a108efd71bfed4/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:31.188657 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070e93-6edd-4f3d-8e9e-4d9e3321a6b2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:31.189147 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070e93-6edd-4f3d-8e9e-4d9e3321a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:31.189499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070e93-6edd-4f3d-8e9e-4d9e3321a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:31.198145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:31.236034 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-db070e93-6edd-4f3d-8e9e-4d9e3321a6b2 None None] MFA Rules not processed for user `8a5b65946dda474fa4a108efd71bfed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:31.238155 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-db070e93-6edd-4f3d-8e9e-4d9e3321a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:31.357025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1373/2768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:31.372606 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:31.375414 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:31.470973 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5290-dec4-418c-ae72-4686940047f6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:31.475971 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:31.476821 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:31.477283 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:31.477667 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:31.489678 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:31.491907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:31.503286 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1396/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:35.727066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7193de5-eee3-4734-99b2-8bbf9059d167 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:35.733560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7193de5-eee3-4734-99b2-8bbf9059d167 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:35.733560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7193de5-eee3-4734-99b2-8bbf9059d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:35.756170 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a7193de5-eee3-4734-99b2-8bbf9059d167 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:35.762146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a7193de5-eee3-4734-99b2-8bbf9059d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:35.924872 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1374/2770] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:35.987756 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:35.990226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:36.051979 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:36.102434 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e953e-fd4d-4628-86fb-5a867ed177f6 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:36.110405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:36.111181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:36.111595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:36.111757 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:36.127164 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:36.130092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:36.149372 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1397/2771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:40.423449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:40.424180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:40.424456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:40.458419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:40.460607 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:40.474339 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1375/2772] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:40.510083 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:40.513061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:40.539435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee276d1-4c80-41a8-96f2-fd9a2a7a92c7 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:40.549122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcc9d-749f-4cc2-a7b5-3e307ed25cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:40.550103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcc9d-749f-4cc2-a7b5-3e307ed25cea service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:40.550524 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcc9d-749f-4cc2-a7b5-3e307ed25cea service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:40.561398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcc9d-749f-4cc2-a7b5-3e307ed25cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:40.566858 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcc9d-749f-4cc2-a7b5-3e307ed25cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:40.568830 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcc9d-749f-4cc2-a7b5-3e307ed25cea service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:40.582905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1398/2773] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:41.591851 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:41.594020 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:41.614910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478aa98-3ca2-4a6f-bd9d-641d65da0e34 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:41.622543 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:41.623381 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:41.623665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:41.624175 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] PATH_INFO: `/v3/users/b37715b3c15e474cb3628f918ebe549d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:41.625626 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37715b3c15e474cb3628f918ebe549d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:41.628029 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:41.843997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37715b3c15e474cb3628f918ebe549d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:41.861338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37715b3c15e474cb3628f918ebe549d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:41.862485 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37715b3c15e474cb3628f918ebe549d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:41.982183 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37715b3c15e474cb3628f918ebe549d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:41.992560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37715b3c15e474cb3628f918ebe549d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:41.995284 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:42.004031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1376/2774] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:41 2022] DELETE /identity/v3/users/b37715b3c15e474cb3628f918ebe549d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:42.008903 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:42.009536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:42.009536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:42.030856 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:42.032125 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:42.103908 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1399/2775] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:42.116124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:42.117704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:42.230331 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117ff5-77f8-4583-b612-2126c9b5e0d6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:42.235621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:42.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:42.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:42.241292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:42.248448 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:42.250328 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:42.264599 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1377/2776] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:42.749100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:42.751100 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:42.766542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a44718-ac26-48f1-966d-9e4b5e356f68 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:42.774158 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:42.774935 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:42.776527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:42.776527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] PATH_INFO: `/v3/projects/7b90ccdd698c49c3a97cdefbbc861a88` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:42.777917 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b90ccdd698c49c3a97cdefbbc861a88)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:42.780559 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:42.934064 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b90ccdd698c49c3a97cdefbbc861a88', 'request_id': 'req-2b57e615-fbd5-4d81-8921-81b0a851d9b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.022005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b90ccdd698c49c3a97cdefbbc861a88', 'request_id': 'req-2b57e615-fbd5-4d81-8921-81b0a851d9b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.033793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b90ccdd698c49c3a97cdefbbc861a88', 'request_id': 'req-2b57e615-fbd5-4d81-8921-81b0a851d9b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.049615 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] The token cache is being invalidate because project 7b90ccdd698c49c3a97cdefbbc861a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:43.049912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.050634 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.052484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1400/2777] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:42 2022] DELETE /identity/v3/projects/7b90ccdd698c49c3a97cdefbbc861a88 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:43.056781 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:43.069990 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b5116-9f32-41e2-ac83-ca6f040f9bcc service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:43.149125 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:43.149906 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:43.150484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:43.151638 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] PATH_INFO: `/v3/users/e135170e297549afa63d5fd7baffbc1a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:43.153076 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e135170e297549afa63d5fd7baffbc1a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:43.155178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:43.348516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e135170e297549afa63d5fd7baffbc1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.364661 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e135170e297549afa63d5fd7baffbc1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.365418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e135170e297549afa63d5fd7baffbc1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.522577 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e135170e297549afa63d5fd7baffbc1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.531869 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ff09af3b-52d5-4ffd-9563-85efb90cd345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e135170e297549afa63d5fd7baffbc1a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:43.534421 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:43.539498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1378/2778] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:43 2022] DELETE /identity/v3/users/e135170e297549afa63d5fd7baffbc1a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:44.198127 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:44.199629 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:44.216204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57e615-fbd5-4d81-8921-81b0a851d9b7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:44.247999 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:44.276451 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:44.277084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:44.277358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:44.277631 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] PATH_INFO: `/v3/projects/3536f5fcc82f461081952b1e32b7e8de` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:44.278804 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3536f5fcc82f461081952b1e32b7e8de)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:44.280710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:44.437136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3536f5fcc82f461081952b1e32b7e8de', 'request_id': 'req-ab144d51-1d20-43a4-864a-eecb2cc3ca20'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:44.637189 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3536f5fcc82f461081952b1e32b7e8de', 'request_id': 'req-ab144d51-1d20-43a4-864a-eecb2cc3ca20'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:44.644361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3536f5fcc82f461081952b1e32b7e8de', 'request_id': 'req-ab144d51-1d20-43a4-864a-eecb2cc3ca20'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:44.655779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] The token cache is being invalidate because project 3536f5fcc82f461081952b1e32b7e8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:44.656070 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:44.656715 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab144d51-1d20-43a4-864a-eecb2cc3ca20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:44.661061 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1401/2779] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:44 2022] DELETE /identity/v3/projects/3536f5fcc82f461081952b1e32b7e8de => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:44.666808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065358-648d-480f-91e3-79c535926469 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:44.667468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065358-648d-480f-91e3-79c535926469 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:44.667468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065358-648d-480f-91e3-79c535926469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:44.689282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6d065358-648d-480f-91e3-79c535926469 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:44.690572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6d065358-648d-480f-91e3-79c535926469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:44.780634 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1379/2780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:44.789067 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:44.789341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:44.789600 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:44.812589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:44.813856 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:44.826881 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1402/2781] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:44.833206 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065358-648d-480f-91e3-79c535926469 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:44.845453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065358-648d-480f-91e3-79c535926469 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:44.852486 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:44.853297 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:44.854412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:44.854792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:44.855973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:44.856788 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:44.858997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:44.877964 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1380/2782] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:47:44.883897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:44.896596 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66df9e-d8d6-4b53-8666-f11d373e7ccc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:44.903193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a590a73-aae6-4310-b8ea-a1edb3b86afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:44.903959 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590a73-aae6-4310-b8ea-a1edb3b86afc admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:44.904336 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590a73-aae6-4310-b8ea-a1edb3b86afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:44.904747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a590a73-aae6-4310-b8ea-a1edb3b86afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:44.905713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590a73-aae6-4310-b8ea-a1edb3b86afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:44.908052 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a590a73-aae6-4310-b8ea-a1edb3b86afc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.034840 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1403/2783] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:44 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:45.040852 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.055748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d4aac-91a3-446c-a939-b62304b29de0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.141388 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.142128 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.142522 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.142928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.143794 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.146535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.146811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.146985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.147401 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.177320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:45.180106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:45.193700 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1404/2784] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:45.221588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.223084 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:45.284795 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1381/2785] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:45 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:45.289899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.305889 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae3ddb-2e1a-40e2-8452-b8fe79742cd7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.314983 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.315875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.316415 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.316834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.318097 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.320191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.332174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fff0-3281-4b58-b35c-ccbc15863ff0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.335971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1382/2786] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:45.340403 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.341322 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.341505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.341753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.342152 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.353108 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574afa37-e199-4db9-8450-5432d3818314 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.354904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.358038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.359601 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af835-2cb5-4c4e-bc67-32f1dc59f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.360361 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af835-2cb5-4c4e-bc67-32f1dc59f91a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.360776 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af835-2cb5-4c4e-bc67-32f1dc59f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.361121 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af835-2cb5-4c4e-bc67-32f1dc59f91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.361952 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af835-2cb5-4c4e-bc67-32f1dc59f91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.364516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af835-2cb5-4c4e-bc67-32f1dc59f91a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.373280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1405/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:45.378667 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1383/2788] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:45.392571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.413008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbcc28-cc75-4418-ad23-8902cca67fae service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.419249 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.419892 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.420277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.420702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] PATH_INFO: `/v3/projects/88dc5ebf215247b786d7a2257efe5349/users/4d4e690a592143829536df0a0635317b/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.435358 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:45.444415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=88dc5ebf215247b786d7a2257efe5349, user_id=4d4e690a592143829536df0a0635317b, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.448099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.562478 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1406/2789] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:45 2022] PUT /identity/v3/projects/88dc5ebf215247b786d7a2257efe5349/users/4d4e690a592143829536df0a0635317b/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:45.582308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.582833 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.583418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.622341 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] MFA Rules not processed for user `4d4e690a592143829536df0a0635317b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:45.624641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:45.697075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:45.738472 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1384/2790] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:45.744027 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.826836 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaadbb4-bd0e-48ad-9f49-21cc2a3950eb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.831921 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.832547 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.832829 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.833103 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.833754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.835782 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.944418 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1407/2791] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:45 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:45.950010 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.963562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad672e9-8fe3-499a-9983-9affda81dd26 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.043863 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.044630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.044941 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.045215 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.045770 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.045907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.047541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.047790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.061930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49885c4e-97d7-4743-bd91-f58aa93be8c7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.066883 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.067564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.067867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.068138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] PATH_INFO: `/v3/users/8a5b65946dda474fa4a108efd71bfed4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.069313 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5b65946dda474fa4a108efd71bfed4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.071295 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.138231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1385/2792] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:45 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:46.142862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.155611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b139f-4475-44a6-888d-33a408eb66c3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.160686 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.161325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.161604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.161879 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.162541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.164325 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.176608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1386/2793] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:46.181400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.192145 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e197d-6a5b-443e-844a-95662fcbff92 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.197019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.197894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.198224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.198506 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] PATH_INFO: `/v3/projects/eb51be93e134429187796177450f5807/users/9c266b502eb649da81ded3cceaf62fb0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.216803 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb51be93e134429187796177450f5807, user_id=9c266b502eb649da81ded3cceaf62fb0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.220689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.259584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5b65946dda474fa4a108efd71bfed4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.260543 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5b65946dda474fa4a108efd71bfed4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.276071 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5b65946dda474fa4a108efd71bfed4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.317031 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1387/2794] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:46 2022] PUT /identity/v3/projects/eb51be93e134429187796177450f5807/users/9c266b502eb649da81ded3cceaf62fb0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:46.320905 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.340426 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5b65946dda474fa4a108efd71bfed4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.341203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe1e5eaa-469e-4a9a-9110-67ab2f9e4b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5b65946dda474fa4a108efd71bfed4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.363399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1408/2795] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/users/8a5b65946dda474fa4a108efd71bfed4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:46.369194 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.369636 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.370263 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.390138 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:46.391366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.399642 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73317-9447-4a79-90c1-14707e6903f7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.440694 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:46.452189 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:46.461502 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1409/2796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:46.466140 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.466787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.467182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.467455 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.468100 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.469728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.471906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.473325 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.481033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1388/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:46.486319 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.488497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.501349 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d330-5141-47ef-8e3f-380f0cf7e5b7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.506720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3909-7250-46b0-95d3-633fdeb81dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.507411 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3909-7250-46b0-95d3-633fdeb81dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.507704 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3909-7250-46b0-95d3-633fdeb81dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.508024 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3909-7250-46b0-95d3-633fdeb81dd6 admin admin] PATH_INFO: `/v3/projects/eb51be93e134429187796177450f5807/users/9c266b502eb649da81ded3cceaf62fb0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.510834 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3909-7250-46b0-95d3-633fdeb81dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb51be93e134429187796177450f5807, user_id=9c266b502eb649da81ded3cceaf62fb0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.513548 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3909-7250-46b0-95d3-633fdeb81dd6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.525208 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1389/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:46 2022] PUT /identity/v3/projects/eb51be93e134429187796177450f5807/users/9c266b502eb649da81ded3cceaf62fb0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:46.536541 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.536766 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.537233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.548718 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab51c8-e803-4a3b-978e-e505a5ec6108 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.568785 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] MFA Rules not processed for user `9c266b502eb649da81ded3cceaf62fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:46.570028 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.609981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.609981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.609981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.609981 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.661560 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1390/2799] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:46.674413 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.675945 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.689915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.694888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.708864 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1410/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:46.787786 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6ec6-b470-4f44-95e9-575991ea2033 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.792971 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.793792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.794194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.794581 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.808762 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.814375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.820451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1391/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:46.982641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.000535 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045ec5b-ce34-4493-bb4e-563eac158d5d service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.007319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.008343 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.009076 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.009487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.012601 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.113128 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:47.127151 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.128806 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab8db1-09e7-4c30-8f54-8c34ec0e6dc6 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.140034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1411/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:47.350310 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.352662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.377588 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abda8-83ab-4d0f-a836-df37f1c7a75a service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.383673 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.384301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.384587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.384972 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] PATH_INFO: `/v3/projects/b20d7200033a4555a3e8899c5972464f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.386385 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20d7200033a4555a3e8899c5972464f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.388471 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.550065 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:47.565997 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20d7200033a4555a3e8899c5972464f', 'request_id': 'req-574a5689-ada0-49c6-9823-57c533feb00b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.684969 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20d7200033a4555a3e8899c5972464f', 'request_id': 'req-574a5689-ada0-49c6-9823-57c533feb00b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.694658 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20d7200033a4555a3e8899c5972464f', 'request_id': 'req-574a5689-ada0-49c6-9823-57c533feb00b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.708536 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] The token cache is being invalidate because project b20d7200033a4555a3e8899c5972464f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:47.709099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.709974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.712164 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1392/2803] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:47 2022] DELETE /identity/v3/projects/b20d7200033a4555a3e8899c5972464f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:48.993008 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848cb2-7b64-4a5f-85b1-74cde39399a3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.994056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848cb2-7b64-4a5f-85b1-74cde39399a3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.994056 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848cb2-7b64-4a5f-85b1-74cde39399a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:49.020256 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a0848cb2-7b64-4a5f-85b1-74cde39399a3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:49.021690 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a0848cb2-7b64-4a5f-85b1-74cde39399a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:49.101702 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1412/2804] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:49.144176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:49.146256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:49.228016 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a5689-ada0-49c6-9823-57c533feb00b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:49.234629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:49.235292 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:49.235580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:49.235846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:49.249512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:49.249512 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:49.259180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1393/2805] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:52.272483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:52.273966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:52.273966 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:52.299960 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:52.301257 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:52.310199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1413/2806] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:52.328557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:52.330854 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:52.346532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a661-17da-49f9-8fb5-f958a05e14aa service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:52.352314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e118a-b9d1-4cf6-b98c-7fc13d77dbca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:52.352926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e118a-b9d1-4cf6-b98c-7fc13d77dbca service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:52.353209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e118a-b9d1-4cf6-b98c-7fc13d77dbca service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:52.354400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e118a-b9d1-4cf6-b98c-7fc13d77dbca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:52.363720 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e118a-b9d1-4cf6-b98c-7fc13d77dbca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:52.365314 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e118a-b9d1-4cf6-b98c-7fc13d77dbca service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:52.376011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1394/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:52.762843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:52.764361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:52.783260 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4f875-1c50-4216-9067-6fbc46f40d89 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:52.788417 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:52.789080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:52.791521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:52.791521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] PATH_INFO: `/v3/users/4d4e690a592143829536df0a0635317b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:52.791521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4e690a592143829536df0a0635317b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:52.793081 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:53.043536 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4e690a592143829536df0a0635317b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:53.044199 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4e690a592143829536df0a0635317b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:53.057228 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4e690a592143829536df0a0635317b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:53.159038 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4e690a592143829536df0a0635317b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:53.159704 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4e690a592143829536df0a0635317b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:53.182929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1414/2808] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:52 2022] DELETE /identity/v3/users/4d4e690a592143829536df0a0635317b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:53.188697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:53.189146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:53.189397 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:53.209572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:53.210855 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:53.273302 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1395/2809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:53.285130 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:53.287097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:53.352621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0d90-6e2a-4d08-9922-2b48a0b31ea0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:53.356761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:53.357464 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:53.357743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:53.358058 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:53.373647 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:53.376115 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:53.383891 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:53.393597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1415/2810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:54.151804 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:54.154578 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:54.168918 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dfd7b-84bf-48b9-9893-e0c144d4a242 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:54.173974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:54.174639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:54.174959 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:54.175258 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] PATH_INFO: `/v3/projects/88dc5ebf215247b786d7a2257efe5349` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:54.176425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88dc5ebf215247b786d7a2257efe5349)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:54.178425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:54.281961 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:54.300715 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88dc5ebf215247b786d7a2257efe5349', 'request_id': 'req-cfb63373-ca1b-4674-a59b-95948d5d3446'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.376479 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88dc5ebf215247b786d7a2257efe5349', 'request_id': 'req-cfb63373-ca1b-4674-a59b-95948d5d3446'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.385567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88dc5ebf215247b786d7a2257efe5349', 'request_id': 'req-cfb63373-ca1b-4674-a59b-95948d5d3446'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.399295 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] The token cache is being invalidate because project 88dc5ebf215247b786d7a2257efe5349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:54.399591 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.400266 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.401811 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1396/2811] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:54 2022] DELETE /identity/v3/projects/88dc5ebf215247b786d7a2257efe5349 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:54.407911 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:54.419980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d3088-5567-450b-a045-8f60bc372ba4 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:54.494952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:54.495833 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:54.496238 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:54.496539 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] PATH_INFO: `/v3/users/9c266b502eb649da81ded3cceaf62fb0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:54.498137 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c266b502eb649da81ded3cceaf62fb0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:54.500398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:54.712301 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c266b502eb649da81ded3cceaf62fb0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.713793 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c266b502eb649da81ded3cceaf62fb0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.731226 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c266b502eb649da81ded3cceaf62fb0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.844519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c266b502eb649da81ded3cceaf62fb0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.845175 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b151b7e7-223b-4dc9-84a0-d8814b3d77f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c266b502eb649da81ded3cceaf62fb0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:54.861967 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1416/2812] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:54 2022] DELETE /identity/v3/users/9c266b502eb649da81ded3cceaf62fb0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:55.363123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:55.363123 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:55.376212 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63373-ca1b-4674-a59b-95948d5d3446 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:55.446210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:55.446900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.448004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.448317 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] PATH_INFO: `/v3/projects/eb51be93e134429187796177450f5807` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.449605 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb51be93e134429187796177450f5807)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:55.451586 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:55.533277 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9140f4-c301-48e3-abb6-52cdc71a3028 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.533899 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9140f4-c301-48e3-abb6-52cdc71a3028 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.534048 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9140f4-c301-48e3-abb6-52cdc71a3028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.558118 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8f9140f4-c301-48e3-abb6-52cdc71a3028 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:55.559415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8f9140f4-c301-48e3-abb6-52cdc71a3028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:55.566931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb51be93e134429187796177450f5807', 'request_id': 'req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:55.633235 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb51be93e134429187796177450f5807', 'request_id': 'req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:55.641787 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb51be93e134429187796177450f5807', 'request_id': 'req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:55.647280 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1417/2813] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:55.655659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] The token cache is being invalidate because project eb51be93e134429187796177450f5807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:55.655949 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:55.656646 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:55.658371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1397/2814] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:55 2022] DELETE /identity/v3/projects/eb51be93e134429187796177450f5807 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:55.663493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25658138-0a1d-4837-baff-0318f6329029 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.663759 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25658138-0a1d-4837-baff-0318f6329029 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.664046 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25658138-0a1d-4837-baff-0318f6329029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.671463 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:55.673253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:55.686503 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-25658138-0a1d-4837-baff-0318f6329029 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:55.687810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-25658138-0a1d-4837-baff-0318f6329029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:55.696521 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1418/2815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:55.706006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.706442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.706868 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.727805 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:55.729587 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:55.737992 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1419/2816] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:55.741405 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:55.742436 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:55.748970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:55.754234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9941e-c4c4-4618-80bc-ac4caccecd80 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:55.759731 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:55.760542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.760820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.761089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.761765 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:55.762069 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:55.764188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:55.777336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f34e86-22b8-4f1b-92cd-89fee4e8907c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:55.778627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1420/2817] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:55.783278 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:55.787086 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:55.787727 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.788012 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.788287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.790193 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:55.795006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ad626-c7d4-48a1-b562-6c5f2406a863 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:55.802949 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:55.803862 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:55.805260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:55.805380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:55.805380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:55.805889 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:55.807732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:55.809906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:55.816437 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1398/2818] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:55.891607 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1421/2819] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:55 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:55.898161 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:55.916763 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7283f8-4ccd-4908-b976-23bd2db7d99b service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.014304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.014887 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.015178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.015451 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.016105 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.018107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.120412 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1399/2820] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:55 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:56.127240 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.146907 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b4042-52e0-43e9-8feb-53e3d5dca49b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.155576 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.156677 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.157191 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.157701 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.159007 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.162302 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.180724 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1422/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:56.185648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.196973 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbab60-bbab-4efb-805a-772ba8418998 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.201988 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bc1b5-e649-4021-95a1-5f0673bdfb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.202611 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bc1b5-e649-4021-95a1-5f0673bdfb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.202927 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bc1b5-e649-4021-95a1-5f0673bdfb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.203202 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bc1b5-e649-4021-95a1-5f0673bdfb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.203966 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bc1b5-e649-4021-95a1-5f0673bdfb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.205573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bc1b5-e649-4021-95a1-5f0673bdfb99 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.217004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1400/2822] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:56.221224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.232961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71fd9-7c76-4c3f-94e4-ee36ff0b7d2c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.238110 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.238824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.239106 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.239380 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] PATH_INFO: `/v3/projects/6429eeff679749a6a93be0631e530425/users/1db0e7c26c0a471fb6c81fb02d87d88e/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.256306 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6429eeff679749a6a93be0631e530425, user_id=1db0e7c26c0a471fb6c81fb02d87d88e, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.258995 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.350944 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1423/2823] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:56 2022] PUT /identity/v3/projects/6429eeff679749a6a93be0631e530425/users/1db0e7c26c0a471fb6c81fb02d87d88e/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:56.363242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.363978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.363978 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.396561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] MFA Rules not processed for user `1db0e7c26c0a471fb6c81fb02d87d88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:56.398110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:56.475767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1401/2824] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:56.481232 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.554180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1aa3a-bd25-4462-bd34-519edf8bae60 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.560433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.561327 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.561616 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.561886 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.562523 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.564466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.662855 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1424/2825] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:56 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:56.667818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.680191 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d6def-5f33-44c7-9ec3-3019a23e06a6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.729579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:56.750504 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.751157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.751445 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.751724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.752375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.754368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.872674 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1402/2826] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:56 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:56.877266 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.892650 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92b79-3088-4c98-b74c-d659dc94a26f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.907075 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.908456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.908456 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.908713 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.909906 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.912114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.927394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1425/2827] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:56.931048 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.943014 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13b97-f22b-481d-ae9c-1ea6f86673f4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.948810 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d838e-15a9-4268-a20a-84457b84b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.949452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d838e-15a9-4268-a20a-84457b84b26d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.949732 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d838e-15a9-4268-a20a-84457b84b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.950004 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d838e-15a9-4268-a20a-84457b84b26d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:56.950669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d838e-15a9-4268-a20a-84457b84b26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:56.952436 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d838e-15a9-4268-a20a-84457b84b26d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:56.964832 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1403/2828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:56.969284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:56.980526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a11f-d17c-4894-9cce-3a1a4c9876d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:56.985385 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:56.986155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:56.986430 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:56.986742 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] PATH_INFO: `/v3/projects/b97a77e213af41c1ba562275a8f8d08a/users/87064b9e5c9846768023b0d86a74cc58/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:57.004102 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97a77e213af41c1ba562275a8f8d08a, user_id=87064b9e5c9846768023b0d86a74cc58, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:57.007512 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:57.081913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1426/2829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:56 2022] PUT /identity/v3/projects/b97a77e213af41c1ba562275a8f8d08a/users/87064b9e5c9846768023b0d86a74cc58/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:57.094167 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:57.094459 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:57.096583 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:57.131199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] MFA Rules not processed for user `87064b9e5c9846768023b0d86a74cc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:57.132356 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:57.207083 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1404/2830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:57.211897 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:57.264398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:57.284529 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954443bd-316e-41cc-b48e-b6ac4ca6a214 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:57.289557 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:57.290180 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:57.290465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:57.295142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:57.295142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:57.295142 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:57.446622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1427/2831] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:57 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:57.451452 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:57.463059 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f65ad-54f5-45f6-9c83-da224b0909ef None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:57.545001 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:57.560604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:57.560604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:57.560604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:57.560604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:57.560604 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:57.714746 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1405/2832] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:57 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:57.718872 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:57.730676 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518de3-f796-4c86-be54-5e29d7bb84bf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:57.735627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:57.736244 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:57.736520 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:57.736792 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:57.737454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:57.739173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:57.751785 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1428/2833] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:57.756351 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:57.768300 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de5b12-4ae0-4564-9fdb-81fcff7f5f70 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:57.773902 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:57.774584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:57.774903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:57.775180 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] PATH_INFO: `/v3/projects/71dab6f5bac34a16af6022c58e9db334/users/e5915dcf69b94209ae3064a9f79d9c66/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:57.793194 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dab6f5bac34a16af6022c58e9db334, user_id=e5915dcf69b94209ae3064a9f79d9c66, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:57.796736 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:58.022379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1406/2834] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:57 2022] PUT /identity/v3/projects/71dab6f5bac34a16af6022c58e9db334/users/e5915dcf69b94209ae3064a9f79d9c66/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:58.028006 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:58.038947 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd8f0-b89a-4caa-8d60-a199fc3bd95c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:58.107871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77c86-9119-46e0-af6d-4594fd20ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:58.108490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77c86-9119-46e0-af6d-4594fd20ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:58.108771 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77c86-9119-46e0-af6d-4594fd20ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:58.109074 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77c86-9119-46e0-af6d-4594fd20ac06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:58.109730 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77c86-9119-46e0-af6d-4594fd20ac06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:58.111433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77c86-9119-46e0-af6d-4594fd20ac06 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:58.122984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1429/2835] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:58.127468 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:58.141431 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2083-825f-4e47-b16e-fba62145de38 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:58.147226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:58.148169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:58.148636 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:58.148934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] PATH_INFO: `/v3/projects/71dab6f5bac34a16af6022c58e9db334/users/e5915dcf69b94209ae3064a9f79d9c66/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:58.151630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dab6f5bac34a16af6022c58e9db334, user_id=e5915dcf69b94209ae3064a9f79d9c66, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:58.154282 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:58.161731 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:58.167337 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1407/2836] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:58 2022] PUT /identity/v3/projects/71dab6f5bac34a16af6022c58e9db334/users/e5915dcf69b94209ae3064a9f79d9c66/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:58.179391 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:58.179681 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:58.180119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:58.216406 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] MFA Rules not processed for user `e5915dcf69b94209ae3064a9f79d9c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:58.217635 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:58.307888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1430/2837] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:47:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:58.319301 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:58.321077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:58.394006 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb4f4-0692-4a48-b87b-cbe735d04c89 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:58.398264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:58.398928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:58.399214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:58.399494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:58.410908 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:58.412497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:58.424913 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1408/2838] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:59.907890 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:59.909774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:59.925745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9602-86e7-4f5f-8e6e-3481c9964c30 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:59.930065 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:59.930781 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:59.931780 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:59.932117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:59.985193 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:00.007648 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:00.009320 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:00.021708 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1431/2839] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:05.619625 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:05.629900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb1fb-df68-46b1-8d52-94ae1c337a4a service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:05.647025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bddc2-844b-4e3c-859c-dbf9245808d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:05.647178 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bddc2-844b-4e3c-859c-dbf9245808d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:05.647402 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bddc2-844b-4e3c-859c-dbf9245808d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:05.647681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bddc2-844b-4e3c-859c-dbf9245808d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:05.725438 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bddc2-844b-4e3c-859c-dbf9245808d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:05.726951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bddc2-844b-4e3c-859c-dbf9245808d9 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:05.737849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1409/2840] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:48:10.755011 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:10.819563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179083-93ff-4ba2-9ffb-764f60e477fe service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:10.824913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:10.825541 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:10.825823 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:10.826099 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] PATH_INFO: `/v3/users/1db0e7c26c0a471fb6c81fb02d87d88e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:10.827273 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db0e7c26c0a471fb6c81fb02d87d88e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:10.829225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:11.070545 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db0e7c26c0a471fb6c81fb02d87d88e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:11.071269 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db0e7c26c0a471fb6c81fb02d87d88e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:11.088394 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db0e7c26c0a471fb6c81fb02d87d88e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:11.192934 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db0e7c26c0a471fb6c81fb02d87d88e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:11.193593 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db0e7c26c0a471fb6c81fb02d87d88e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:11.208237 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1432/2841] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:10 2022] DELETE /identity/v3/users/1db0e7c26c0a471fb6c81fb02d87d88e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:11.213138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:11.213659 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:11.213770 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:11.235807 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:11.236458 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:11.304724 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1410/2842] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:11.314171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:11.315621 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:11.381929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cb523-3c25-4521-a2d0-fd9efd94c6d5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:11.386939 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:11.387551 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:11.387863 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:11.388139 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:11.397904 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:11.399399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:11.405462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:11.410640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1433/2843] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:11.830518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:11.832371 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:11.845133 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ca72d-7927-4c42-9ce9-3dcdae66b161 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:11.850777 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:11.852305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:11.852305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:11.852305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] PATH_INFO: `/v3/projects/6429eeff679749a6a93be0631e530425` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:11.854223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6429eeff679749a6a93be0631e530425)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:11.856253 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:11.970892 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:11.982069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6429eeff679749a6a93be0631e530425', 'request_id': 'req-f9a220de-f34b-4b38-b9d3-2963ef192048'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.058748 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6429eeff679749a6a93be0631e530425', 'request_id': 'req-f9a220de-f34b-4b38-b9d3-2963ef192048'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.065537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6429eeff679749a6a93be0631e530425', 'request_id': 'req-f9a220de-f34b-4b38-b9d3-2963ef192048'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.076706 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] The token cache is being invalidate because project 6429eeff679749a6a93be0631e530425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:12.076999 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.077641 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.079226 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1411/2844] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:11 2022] DELETE /identity/v3/projects/6429eeff679749a6a93be0631e530425 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:12.083200 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:12.093333 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cd655-6d94-4969-8e38-f514bf5f1b4f service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:12.150581 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:12.151242 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:12.151525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:12.151802 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] PATH_INFO: `/v3/users/87064b9e5c9846768023b0d86a74cc58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:12.152940 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87064b9e5c9846768023b0d86a74cc58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:12.154927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:12.329745 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87064b9e5c9846768023b0d86a74cc58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.330496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87064b9e5c9846768023b0d86a74cc58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.346330 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87064b9e5c9846768023b0d86a74cc58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.467143 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87064b9e5c9846768023b0d86a74cc58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.467774 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87064b9e5c9846768023b0d86a74cc58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:12.481402 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1434/2845] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:12 2022] DELETE /identity/v3/users/87064b9e5c9846768023b0d86a74cc58 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:12.909567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:12.911025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:12.926846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a220de-f34b-4b38-b9d3-2963ef192048 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:12.989373 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:12.990036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:12.990345 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:12.990616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] PATH_INFO: `/v3/projects/b97a77e213af41c1ba562275a8f8d08a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:12.991783 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97a77e213af41c1ba562275a8f8d08a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:12.993696 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:13.129767 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97a77e213af41c1ba562275a8f8d08a', 'request_id': 'req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.227293 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97a77e213af41c1ba562275a8f8d08a', 'request_id': 'req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.235666 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97a77e213af41c1ba562275a8f8d08a', 'request_id': 'req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.247220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] The token cache is being invalidate because project b97a77e213af41c1ba562275a8f8d08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:13.247557 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.248308 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e54a9b28-6100-40e7-9a9f-3100a7f9d1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.249824 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1412/2846] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:12 2022] DELETE /identity/v3/projects/b97a77e213af41c1ba562275a8f8d08a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:13.254097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:13.255787 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:13.272298 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe168f6-4086-4360-8d2e-4821e808483a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:13.336719 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:13.337931 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:13.338211 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:13.338495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] PATH_INFO: `/v3/users/e5915dcf69b94209ae3064a9f79d9c66` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:13.339685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5915dcf69b94209ae3064a9f79d9c66)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:13.341884 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:13.367262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:13.809250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:13.809616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:13.809931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:13.830218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] MFA Rules not processed for user `49767d62abe947e5a3407a719f0d0dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:13.831521 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:13.884716 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:13.892579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1413/2847] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:13.934217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5915dcf69b94209ae3064a9f79d9c66'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.935182 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5915dcf69b94209ae3064a9f79d9c66'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:13.949505 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5915dcf69b94209ae3064a9f79d9c66'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:14.050369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5915dcf69b94209ae3064a9f79d9c66'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:14.051023 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5915dcf69b94209ae3064a9f79d9c66'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:14.067365 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1435/2848] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:13 2022] DELETE /identity/v3/users/e5915dcf69b94209ae3064a9f79d9c66 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:14.177418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:14.179689 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:14.240359 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc8b5b-ef91-4dd4-87f5-e5321bda54d4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:14.301552 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:14.303051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:14.303051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:14.303051 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:14.305440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:14.316894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:14.318281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a977f-7410-4731-98a7-bfdcd1430913 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:14.327849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1414/2849] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:14.591077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:14.593089 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:14.682622 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e34a1-38cb-435e-a6d6-30113f6ac603 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:14.687299 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:14.687952 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:14.688230 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:14.688501 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] PATH_INFO: `/v3/projects/71dab6f5bac34a16af6022c58e9db334` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:14.689655 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dab6f5bac34a16af6022c58e9db334)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:14.691626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:14.911196 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dab6f5bac34a16af6022c58e9db334', 'request_id': 'req-edbcf4ec-3f56-4f80-8d91-882e4b016d61'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:15.015542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dab6f5bac34a16af6022c58e9db334', 'request_id': 'req-edbcf4ec-3f56-4f80-8d91-882e4b016d61'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:15.023105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dab6f5bac34a16af6022c58e9db334', 'request_id': 'req-edbcf4ec-3f56-4f80-8d91-882e4b016d61'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:15.035626 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] The token cache is being invalidate because project 71dab6f5bac34a16af6022c58e9db334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:15.035912 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:15.036571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-edbcf4ec-3f56-4f80-8d91-882e4b016d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:15.038309 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1436/2850] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:14 2022] DELETE /identity/v3/projects/71dab6f5bac34a16af6022c58e9db334 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:15.047241 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.047598 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.047934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.068561 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:15.069915 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:15.140192 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1415/2851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:15.154093 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adac07-d907-431b-842e-e86de9708a00 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.154526 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adac07-d907-431b-842e-e86de9708a00 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.154985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adac07-d907-431b-842e-e86de9708a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.191223 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-64adac07-d907-431b-842e-e86de9708a00 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:15.193288 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-64adac07-d907-431b-842e-e86de9708a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:15.207119 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1437/2852] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:15.214186 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:15.229338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f013f7-5ee9-40f6-9687-649fd2b0d570 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:15.234011 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:15.234615 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.234923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.235195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.235849 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:48:15.236150 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:15.237734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:15.254846 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1416/2853] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:48:15.257573 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adac07-d907-431b-842e-e86de9708a00 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:15.266219 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adac07-d907-431b-842e-e86de9708a00 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:15.272710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:15.273307 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.273674 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.274013 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.275029 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:15.276915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:15.485405 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:15.492943 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1438/2854] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:15 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:15.497707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:15.508168 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1f2be-414f-4cbf-a2ff-8f8f1bc63990 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:15.558590 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:15.571568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:15.573273 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.573550 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.573825 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.574519 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:15.576477 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:15.742792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1417/2855] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:15 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:15.746976 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:15.757909 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fee63-108a-4080-ab67-40ab0bf56d73 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:15.763508 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:15.764114 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.764389 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.764656 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.765300 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:15.766915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:15.778747 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1439/2856] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:48:15.784106 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:15.794347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e7724-f04a-4da1-ad00-de861b8aed4d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:15.799257 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03df8f-2ea6-4b70-a4af-8271fd038ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:15.799875 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03df8f-2ea6-4b70-a4af-8271fd038ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.800153 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03df8f-2ea6-4b70-a4af-8271fd038ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.800424 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03df8f-2ea6-4b70-a4af-8271fd038ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.801068 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03df8f-2ea6-4b70-a4af-8271fd038ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:15.802648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03df8f-2ea6-4b70-a4af-8271fd038ad7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:15.816013 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1418/2857] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:15.820350 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:15.835561 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eb0e6-77b1-47e9-ad3a-31ec7048decb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:15.848442 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:15.849958 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:15.850454 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:15.851003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] PATH_INFO: `/v3/projects/96a0da8a01444bf497063f726a8a3d80/users/abcb43964fbb4c94ae65accc0c151aa7/roles/704ea304308b4c07a422828221278e65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:15.869296 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a0da8a01444bf497063f726a8a3d80, user_id=abcb43964fbb4c94ae65accc0c151aa7, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:15.872234 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.012078 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1440/2858] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:15 2022] PUT /identity/v3/projects/96a0da8a01444bf497063f726a8a3d80/users/abcb43964fbb4c94ae65accc0c151aa7/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:16.017518 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.017809 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.018096 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.048951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] MFA Rules not processed for user `abcb43964fbb4c94ae65accc0c151aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:16.050176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:16.121513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1419/2859] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:16.126214 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:16.192319 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a683d60-26e1-40b1-ae54-30759cdd302f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:16.197216 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:16.197888 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.198166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.198435 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.199105 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:16.201035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.366511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1441/2860] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:16 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:16.371903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:16.383573 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8440e6-a8f6-4080-a03a-624016516140 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:16.450290 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:16.450974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.451260 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.451534 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.452169 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:16.454144 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.581662 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1420/2861] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:16 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:48:16.585961 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:16.596527 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f34b2-b27d-479f-be3a-2ae85e9ef510 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:16.601637 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:16.601969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.602247 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.602583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.603798 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:16.605409 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.616773 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1442/2862] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:16.621864 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:16.632172 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b45055-318c-4bed-aaa7-522af3aff34b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:16.637703 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:16.638363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.638791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.639069 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] PATH_INFO: `/v3/projects/83bf4801dbd34a0e8831dd126da949ce/users/e444163b1c7342debafe04b4c3dc28c0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.655456 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bf4801dbd34a0e8831dd126da949ce, user_id=e444163b1c7342debafe04b4c3dc28c0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:16.658134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.773940 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1421/2863] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:16 2022] PUT /identity/v3/projects/83bf4801dbd34a0e8831dd126da949ce/users/e444163b1c7342debafe04b4c3dc28c0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:16.779519 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:16.793231 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f68c2-0836-4914-899d-6eddfa251a93 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:16.854107 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc7f47-066a-44fd-ba12-23d1b9d98e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:16.854705 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc7f47-066a-44fd-ba12-23d1b9d98e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.854994 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc7f47-066a-44fd-ba12-23d1b9d98e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.855262 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc7f47-066a-44fd-ba12-23d1b9d98e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.855913 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc7f47-066a-44fd-ba12-23d1b9d98e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:16.857721 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc7f47-066a-44fd-ba12-23d1b9d98e5c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.871225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1443/2864] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:16.876498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:16.887866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b87a-2fe9-4fe6-8f2c-bf869fe9d3fb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:16.892914 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:16.893587 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.893885 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.894250 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] PATH_INFO: `/v3/projects/83bf4801dbd34a0e8831dd126da949ce/users/e444163b1c7342debafe04b4c3dc28c0/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.896499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bf4801dbd34a0e8831dd126da949ce, user_id=e444163b1c7342debafe04b4c3dc28c0, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:16.900287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:16.911286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1422/2865] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:16 2022] PUT /identity/v3/projects/83bf4801dbd34a0e8831dd126da949ce/users/e444163b1c7342debafe04b4c3dc28c0/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:16.924552 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:16.924842 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:16.925188 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:16.955491 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] MFA Rules not processed for user `e444163b1c7342debafe04b4c3dc28c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:16.956732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:16.983155 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:17.030160 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1444/2866] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:17.043630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:17.045304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:17.055347 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:17.122755 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397ccf-2bf1-426b-ae2b-96362ddb6f0b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:17.127201 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80019-0cd6-493e-9feb-289ff4d9e66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:17.127829 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80019-0cd6-493e-9feb-289ff4d9e66e service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:17.128110 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80019-0cd6-493e-9feb-289ff4d9e66e service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:17.128501 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80019-0cd6-493e-9feb-289ff4d9e66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:17.139484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a80019-0cd6-493e-9feb-289ff4d9e66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:17.140954 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a80019-0cd6-493e-9feb-289ff4d9e66e service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:17.152380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1423/2867] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:18.565449 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:18.640837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5b03-e74b-4ebb-9a13-856210a43372 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:18.646465 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:18.647317 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:18.647595 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:18.647869 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] PATH_INFO: `/v3/users/abcb43964fbb4c94ae65accc0c151aa7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:18.649080 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcb43964fbb4c94ae65accc0c151aa7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:18.651111 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:18.898366 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcb43964fbb4c94ae65accc0c151aa7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:18.898984 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcb43964fbb4c94ae65accc0c151aa7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:18.912692 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcb43964fbb4c94ae65accc0c151aa7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:18.981379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcb43964fbb4c94ae65accc0c151aa7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:18.982002 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcb43964fbb4c94ae65accc0c151aa7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:18.999646 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1445/2868] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:18 2022] DELETE /identity/v3/users/abcb43964fbb4c94ae65accc0c151aa7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:19.004603 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:19.005165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:19.005165 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:19.025545 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:19.026791 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:19.092532 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1424/2869] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:48:19.103305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:19.104955 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:19.171364 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:19.186969 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c96b-c960-4df5-86ef-e54be208037a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:19.190810 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:19.191861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:19.191861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:19.192035 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:19.204893 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:19.206328 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:19.217077 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1446/2870] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:20.082589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:20.082589 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:20.093836 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957c2c2-5e1e-4aeb-b4e2-7e04d6d71df4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:20.098487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:20.099220 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:20.099498 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:20.099797 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] PATH_INFO: `/v3/projects/96a0da8a01444bf497063f726a8a3d80` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:20.100934 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a0da8a01444bf497063f726a8a3d80)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:20.103572 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:20.237858 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a0da8a01444bf497063f726a8a3d80', 'request_id': 'req-5b385088-65f2-4a33-a229-7287d24e2ef0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.313007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a0da8a01444bf497063f726a8a3d80', 'request_id': 'req-5b385088-65f2-4a33-a229-7287d24e2ef0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.321935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a0da8a01444bf497063f726a8a3d80', 'request_id': 'req-5b385088-65f2-4a33-a229-7287d24e2ef0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.334323 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] The token cache is being invalidate because project 96a0da8a01444bf497063f726a8a3d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:20.334616 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.335304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.336790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1425/2871] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:20 2022] DELETE /identity/v3/projects/96a0da8a01444bf497063f726a8a3d80 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:20.341564 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:20.351525 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432028ea-27d1-456f-9840-c0ed9ed6cc4f service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:20.419202 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:20.419849 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:20.420126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:20.420397 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] PATH_INFO: `/v3/users/e444163b1c7342debafe04b4c3dc28c0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:20.421585 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e444163b1c7342debafe04b4c3dc28c0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:20.423660 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:20.675120 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e444163b1c7342debafe04b4c3dc28c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.675827 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e444163b1c7342debafe04b4c3dc28c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.695915 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e444163b1c7342debafe04b4c3dc28c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.792816 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e444163b1c7342debafe04b4c3dc28c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.797218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6b5288ee-7178-4cc9-b968-04e19bd615c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e444163b1c7342debafe04b4c3dc28c0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:20.811433 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1447/2872] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:20 2022] DELETE /identity/v3/users/e444163b1c7342debafe04b4c3dc28c0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:21.428635 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:21.430082 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:21.451259 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385088-65f2-4a33-a229-7287d24e2ef0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:21.492367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:21.519264 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:21.520025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:21.520568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:21.520957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] PATH_INFO: `/v3/projects/83bf4801dbd34a0e8831dd126da949ce` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:21.522019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bf4801dbd34a0e8831dd126da949ce)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:21.523950 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:21.685707 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bf4801dbd34a0e8831dd126da949ce', 'request_id': 'req-fde09c41-25ff-44e2-ba53-163118b0a802'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:21.763842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bf4801dbd34a0e8831dd126da949ce', 'request_id': 'req-fde09c41-25ff-44e2-ba53-163118b0a802'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:21.771095 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bf4801dbd34a0e8831dd126da949ce', 'request_id': 'req-fde09c41-25ff-44e2-ba53-163118b0a802'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:21.783043 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] The token cache is being invalidate because project 83bf4801dbd34a0e8831dd126da949ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:21.783330 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:21.783992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:21.795734 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1426/2873] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:21 2022] DELETE /identity/v3/projects/83bf4801dbd34a0e8831dd126da949ce => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:30.807898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:31.780935 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:31.907582 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4c63-c84d-48f4-ad77-156d698449b3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:31.908181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4c63-c84d-48f4-ad77-156d698449b3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:31.908181 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4c63-c84d-48f4-ad77-156d698449b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:31.929218 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-51fe4c63-c84d-48f4-ad77-156d698449b3 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:31.930463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51fe4c63-c84d-48f4-ad77-156d698449b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:31.995686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1448/2874] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:32.015499 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:32.017055 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:32.099928 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09c41-25ff-44e2-ba53-163118b0a802 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:32.106243 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:32.106899 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:32.107182 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:32.107453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:32.116224 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:32.117842 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:32.129205 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1427/2875] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:48:35.418589 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5c33a-2f31-42f2-8af6-b9f84e0c4382 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:35.419415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5c33a-2f31-42f2-8af6-b9f84e0c4382 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:35.419415 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5c33a-2f31-42f2-8af6-b9f84e0c4382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:35.439754 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-92a5c33a-2f31-42f2-8af6-b9f84e0c4382 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:35.440972 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-92a5c33a-2f31-42f2-8af6-b9f84e0c4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:35.448902 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1449/2876] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:35.474567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:35.476075 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:35.492107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae1c71-96d4-4959-b773-528344245510 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:35.499171 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:35.499818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:35.500104 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:35.500382 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:35.509500 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:35.511841 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:35.522774 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1428/2877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:38.343387 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf3b73-f8e7-4884-a659-ee9895df56b8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:38.344041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf3b73-f8e7-4884-a659-ee9895df56b8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:38.344041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf3b73-f8e7-4884-a659-ee9895df56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:38.365375 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-edaf3b73-f8e7-4884-a659-ee9895df56b8 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:38.366592 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-edaf3b73-f8e7-4884-a659-ee9895df56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:38.375363 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1450/2878] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:38.396184 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:38.407900 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e16ca6-546e-4787-bfb7-ee7df3c6273d service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:38.417910 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:38.418574 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:38.419030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:38.419383 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:38.428698 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:38.430265 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:38.440621 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1429/2879] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:48:41.587468 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770353-5824-45f2-9725-ee3b0105ae54 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:41.588905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770353-5824-45f2-9725-ee3b0105ae54 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:41.588905 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770353-5824-45f2-9725-ee3b0105ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:41.616174 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cd770353-5824-45f2-9725-ee3b0105ae54 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:41.617652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cd770353-5824-45f2-9725-ee3b0105ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:41.626665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1451/2880] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:48:41.645628 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:41.659176 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5254a20-4b4b-41bc-9e17-2ebe4897d9d5 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:41.665326 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:41.665957 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:41.666239 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:41.667211 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:41.676808 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:41.678400 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:41.689790 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1430/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:48:44.850779 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.851421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.851421 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.872685 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:44.873970 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:44.882136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1452/2882] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:44.908933 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:44.921287 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba66e3-be96-44fe-984b-aa3b2a20209e service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:44.927124 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:44.927739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.928015 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.928286 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.938099 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:44.939739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:44.951060 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1431/2883] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:54.866437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=39 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:54.945681 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=58 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:20.199479 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:20.201032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:20.213686 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69467e1-b6d9-4587-a79a-01db2304d8e9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:20.220086 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:20.220791 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:20.221241 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:20.221732 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] PATH_INFO: `/v3/users/49767d62abe947e5a3407a719f0d0dc1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:20.224068 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] RBAC: Authorizing `identity:delete_user(user_id=49767d62abe947e5a3407a719f0d0dc1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:20.227136 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:20.537837 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49767d62abe947e5a3407a719f0d0dc1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:20.538493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49767d62abe947e5a3407a719f0d0dc1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:20.550497 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49767d62abe947e5a3407a719f0d0dc1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:20.629861 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49767d62abe947e5a3407a719f0d0dc1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:20.630627 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1a3988e7-7fa7-4c82-a4fb-159d74ec407e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49767d62abe947e5a3407a719f0d0dc1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:20.647225 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1453/2884] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:49:20 2022] DELETE /identity/v3/users/49767d62abe947e5a3407a719f0d0dc1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:49:20.913497 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:20.924733 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19a64-d64e-4139-b75a-d4b13fec9968 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:21.001894 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:21.002568 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.002891 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.003209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] PATH_INFO: `/v3/projects/e7641ccb811449cd8ac4c61f9f581d9a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.005223 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7641ccb811449cd8ac4c61f9f581d9a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:21.007281 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:21.186185 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7641ccb811449cd8ac4c61f9f581d9a', 'request_id': 'req-5df187af-75c3-458c-adf6-9022dff56afa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:21.286728 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7641ccb811449cd8ac4c61f9f581d9a', 'request_id': 'req-5df187af-75c3-458c-adf6-9022dff56afa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:21.294242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7641ccb811449cd8ac4c61f9f581d9a', 'request_id': 'req-5df187af-75c3-458c-adf6-9022dff56afa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:21.306066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] The token cache is being invalidate because project e7641ccb811449cd8ac4c61f9f581d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:49:21.306352 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:21.307025 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5df187af-75c3-458c-adf6-9022dff56afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:49:21.308520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1432/2885] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:49:20 2022] DELETE /identity/v3/projects/e7641ccb811449cd8ac4c61f9f581d9a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:49:21.313528 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.314051 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.314166 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.342337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:21.342337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:21.415554 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1454/2886] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:21.423584 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.423877 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.424157 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.445826 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:21.448389 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:21.455367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1433/2887] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:21.460019 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:21.469710 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0fa1-fb3c-48b8-a8ee-00a40a572853 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:21.475054 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:21.477092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.477092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.477092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.477092 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:49:21.477602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:21.478739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:21.492203 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1455/2888] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 05:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:49:21.497336 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:21.511126 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823439da-612b-4cce-970c-a8e3f57c0d8f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:21.515931 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:21.516537 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.516815 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.517087 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.517714 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:21.519844 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:21.672094 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1434/2889] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:49:21 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:49:21.677927 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:21.688285 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe9bb-d600-49b6-9242-cc2cccc14f6b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:21.747614 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:21.748221 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.748496 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.748786 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.749396 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:21.751337 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:21.759341 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:21.934784 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1456/2890] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:49:21 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:49:21.939154 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:21.949669 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d891c-1b93-40d0-88ee-c680844708da admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:21.954277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:21.954926 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.955210 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.955484 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.956129 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:21.958496 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:21.969214 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1435/2891] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:49:21.974187 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:21.984619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b5f01-6818-4fe5-88e9-99ce0b627f89 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:21.989411 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac773cc-01b1-410c-8ff2-5300395341ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:21.990034 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac773cc-01b1-410c-8ff2-5300395341ce admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:21.990314 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac773cc-01b1-410c-8ff2-5300395341ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:21.990588 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac773cc-01b1-410c-8ff2-5300395341ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:21.991284 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac773cc-01b1-410c-8ff2-5300395341ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:21.992900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac773cc-01b1-410c-8ff2-5300395341ce admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:22.006516 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1457/2892] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:49:22.010907 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:22.022380 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95715f-5c1e-4a05-a678-cee9ae7afd4b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:22.027246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:22.027975 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:22.028256 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:22.028531 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] PATH_INFO: `/v3/projects/4baeb59f9acc40649e5471c4ee53f060/users/fd27d457ea664b43bc6213d5ff930d6d/roles/704ea304308b4c07a422828221278e65` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:22.046562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baeb59f9acc40649e5471c4ee53f060, user_id=fd27d457ea664b43bc6213d5ff930d6d, role_id=704ea304308b4c07a422828221278e65)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:22.049375 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:22.123418 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1436/2893] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:49:22 2022] PUT /identity/v3/projects/4baeb59f9acc40649e5471c4ee53f060/users/fd27d457ea664b43bc6213d5ff930d6d/roles/704ea304308b4c07a422828221278e65 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:49:22.128463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa6cfe-560d-4a1b-9d95-fbb709bd0860 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:22.128748 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa6cfe-560d-4a1b-9d95-fbb709bd0860 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:22.129018 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa6cfe-560d-4a1b-9d95-fbb709bd0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:22.148657 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9afa6cfe-560d-4a1b-9d95-fbb709bd0860 None None] MFA Rules not processed for user `e8573ad460824b098e5067d101527da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:22.149920 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9afa6cfe-560d-4a1b-9d95-fbb709bd0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:22.211991 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1458/2894] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:22.223530 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:22.225509 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:22.246462 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:22.288240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159603fa-2ef2-4422-a441-c0ce5e833f67 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:22.292033 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:22.292648 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:22.292925 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:22.293225 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:22.302508 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:22.304114 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:22.313903 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1437/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:28.259041 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.259590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.259590 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.293346 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] MFA Rules not processed for user `fd27d457ea664b43bc6213d5ff930d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:28.295085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:28.394261 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1459/2896] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:49:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:49:28.399113 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:28.410367 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7e75a-af1f-4371-8c79-bfc9f44167de service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:28.416084 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:28.416792 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.417146 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.417491 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.418209 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:28.420513 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:28.527077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1438/2897] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 05:49:28 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:49:28.534670 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:28.541474 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f356-7ebc-4047-860b-367ac02c4def None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:28.604673 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:28.605303 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.605583 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.605852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.606490 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:28.608530 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:28.686813 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:28.693463 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1460/2898] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 05:49:28 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:49:28.697432 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:28.708425 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178b5a7-7218-4dec-ba64-6aca3787fe4a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:28.713107 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:28.713697 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.713976 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.714246 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.714916 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:28.716493 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:28.728444 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1439/2899] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:49:28.732716 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:28.743493 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d876a9-ccf8-4658-a356-90f076a72930 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:28.748753 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:28.749598 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.749898 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.750687 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] PATH_INFO: `/v3/projects/11b9c10ea75d410a939075787dbd71fb/users/ac0dba5c8b4a457d9180d40e21c81d2b/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.766173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b9c10ea75d410a939075787dbd71fb, user_id=ac0dba5c8b4a457d9180d40e21c81d2b, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:28.768874 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:28.841619 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1461/2900] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:49:28 2022] PUT /identity/v3/projects/11b9c10ea75d410a939075787dbd71fb/users/ac0dba5c8b4a457d9180d40e21c81d2b/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:49:28.845629 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:28.856567 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b342-9368-4b99-a1c9-902392fed793 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:28.915023 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5be01-7b8a-482a-af2f-d60938b6f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:28.915665 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5be01-7b8a-482a-af2f-d60938b6f643 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.915944 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5be01-7b8a-482a-af2f-d60938b6f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.916213 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5be01-7b8a-482a-af2f-d60938b6f643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.916865 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5be01-7b8a-482a-af2f-d60938b6f643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:28.918510 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5be01-7b8a-482a-af2f-d60938b6f643 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:28.928482 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1440/2901] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 05:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:49:28.932699 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:28.943867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0397-b02f-4c4f-8730-e8ddc67def7b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:28.948484 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:28.949126 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:28.949399 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:28.949665 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] PATH_INFO: `/v3/projects/11b9c10ea75d410a939075787dbd71fb/users/ac0dba5c8b4a457d9180d40e21c81d2b/roles/afa0ce309d704597adab4050e9d32d4d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:28.951597 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b9c10ea75d410a939075787dbd71fb, user_id=ac0dba5c8b4a457d9180d40e21c81d2b, role_id=afa0ce309d704597adab4050e9d32d4d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:28.954197 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:28.965304 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1462/2902] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 05:49:28 2022] PUT /identity/v3/projects/11b9c10ea75d410a939075787dbd71fb/users/ac0dba5c8b4a457d9180d40e21c81d2b/roles/afa0ce309d704597adab4050e9d32d4d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:49:34.830743 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610170-f6b4-41af-9335-3846403b2ddb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:34.831749 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610170-f6b4-41af-9335-3846403b2ddb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:34.832218 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610170-f6b4-41af-9335-3846403b2ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:34.866338 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-78610170-f6b4-41af-9335-3846403b2ddb None None] MFA Rules not processed for user `ac0dba5c8b4a457d9180d40e21c81d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:34.867627 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-78610170-f6b4-41af-9335-3846403b2ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:34.956921 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1441/2903] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:49:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:34.975494 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:34.977641 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:35.069900 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9b06-d19d-4ccb-adc7-e694de38160e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:35.075743 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:35.076377 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:35.076658 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:35.076930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:35.142422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:35.144171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:35.154628 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1463/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:38.499254 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:38.499818 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:38.500077 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:38.521242 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] MFA Rules not processed for user `fd27d457ea664b43bc6213d5ff930d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:38.522683 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:38.532277 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1442/2905] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 05:49:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:45.149964 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:48.515233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:54.555122 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:54.556584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:54.619928 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c44aed-ab67-47d6-96a6-7546464749ee service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:54.623709 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dddbf44c00e7411db8084d75fee531e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:54.624462 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:54.624733 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:54.625001 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:54.626814 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:54.641510 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:54.643055 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:54.655929 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1464/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:55.649066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:55.650579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:55.723332 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecefe3-a39a-4cb5-b04e-6de819ad3d64 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:55.728019 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:55.728739 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:55.729030 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:55.729305 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:55.731376 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:55.747036 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:55.748495 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:55.763651 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1443/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:59.152206 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:59.164965 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2dd2-9a4d-4178-9809-5b4a7b6844e5 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:59.169997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:59.169997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:59.169997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:59.169997 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:59.171871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:59.190305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:59.191852 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:59.203563 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1465/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:05.755857 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=26 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:09.197826 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=32 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:10.075593 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:10.084951 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e88fc-885b-4dd5-b32b-72090552fa8c service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:10.088676 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:10.089270 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:10.089553 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:10.089828 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:10.098866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:10.101138 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:10.110544 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1444/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:20.106467 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:23.375483 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.384652 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad143-d50a-4d7c-a4d3-07d63e5291b6 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.389003 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.389608 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.389894 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.390171 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.391989 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.403217 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.404763 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.413560 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1466/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:23.490904 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.500042 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20618e-a360-4550-ba43-1625ad56118d service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.512524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bcaefa6121424bb28c87f8d8729dad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.512524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.512524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.512524 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.512974 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.521355 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.523070 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.535101 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1445/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:23.597305 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.598739 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.670032 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aebd77-e942-4c72-bad6-bd3266ae46fb service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.675422 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.676031 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.676308 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.676577 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.678369 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.690204 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.691809 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.703097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1467/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:25.621098 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.633379 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077f279-7a30-4551-9c16-03db2523c030 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.642304 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.643404 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.643700 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.643992 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.647520 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.664135 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.666233 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.680195 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1446/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:29.770843 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:29.782549 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c86195-f725-438c-a66d-f3d8c264ef1d service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:29.790661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:29.790661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:29.790661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:29.790661 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:29.791117 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:29.803642 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:29.805316 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:29.816398 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1468/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:35.675088 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=12 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:39.811930 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=44 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:47.984546 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:47.987995 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:48.011231 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a61f1-3c6c-4a9a-b4b1-a6fe2419ff0d service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:48.023440 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:48.024244 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:48.024416 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:48.025420 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:48.030644 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:48.045817 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:48.047525 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:48.062761 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1447/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:50.677871 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.690542 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9bdd2-5e04-4529-ad53-5996f55dc4fc service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.696026 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5704b06613b94c92896a39fc2b24c280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.699571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.699571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.699571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.699571 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:50.711820 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.714367 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.725388 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1469/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:57.156923 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:57.158449 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:57.173362 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efab9f-111a-441c-8188-4b7c8b05d64e service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:57.178419 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:57.179079 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:57.179363 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:57.179637 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:57.181368 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:57.194427 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:57.196064 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:57.206968 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1448/2917] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:00.720885 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:01.014707 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.089379 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959da9e7-82a5-4598-bac2-17dc5023824f service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.094156 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.094824 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.095101 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.095371 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] PATH_INFO: `/v3/users/fd27d457ea664b43bc6213d5ff930d6d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.096504 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd27d457ea664b43bc6213d5ff930d6d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.098428 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.329005 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd27d457ea664b43bc6213d5ff930d6d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.329767 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd27d457ea664b43bc6213d5ff930d6d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.343835 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd27d457ea664b43bc6213d5ff930d6d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.456565 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd27d457ea664b43bc6213d5ff930d6d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.457222 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd27d457ea664b43bc6213d5ff930d6d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.473938 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1470/2918] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:01 2022] DELETE /identity/v3/users/fd27d457ea664b43bc6213d5ff930d6d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:01.720516 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.731901 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5d33-697d-440f-a6b4-7ef159633865 service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.805608 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.806579 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.807580 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.807998 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] PATH_INFO: `/v3/projects/4baeb59f9acc40649e5471c4ee53f060` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.809779 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baeb59f9acc40649e5471c4ee53f060)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.812158 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.920866 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baeb59f9acc40649e5471c4ee53f060', 'request_id': 'req-b6e9b6ac-b040-4117-bc26-9b29640c23ac'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.993802 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baeb59f9acc40649e5471c4ee53f060', 'request_id': 'req-b6e9b6ac-b040-4117-bc26-9b29640c23ac'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.001562 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baeb59f9acc40649e5471c4ee53f060', 'request_id': 'req-b6e9b6ac-b040-4117-bc26-9b29640c23ac'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.012775 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] The token cache is being invalidate because project 4baeb59f9acc40649e5471c4ee53f060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:02.013062 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.017630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.017630 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1449/2919] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:01 2022] DELETE /identity/v3/projects/4baeb59f9acc40649e5471c4ee53f060 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:02.019466 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:02.020993 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.034832 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea536-0000-4e63-bc94-ccce1e0d0765 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:02.094880 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:02.095602 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:02.095817 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:02.096085 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] PATH_INFO: `/v3/users/ac0dba5c8b4a457d9180d40e21c81d2b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:02.097254 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0dba5c8b4a457d9180d40e21c81d2b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:02.099224 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:02.126640 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:02.420437 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0dba5c8b4a457d9180d40e21c81d2b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.421173 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0dba5c8b4a457d9180d40e21c81d2b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.435149 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0dba5c8b4a457d9180d40e21c81d2b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.548361 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0dba5c8b4a457d9180d40e21c81d2b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.549004 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0dba5c8b4a457d9180d40e21c81d2b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.562740 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1471/2920] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:02 2022] DELETE /identity/v3/users/ac0dba5c8b4a457d9180d40e21c81d2b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:02.820494 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:02.823487 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.843240 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b6ac-b040-4117-bc26-9b29640c23ac admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:02.917066 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8573ad460824b098e5067d101527da0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbd4e8f6f06741eca1091b51da45521e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:02.921007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:02.921007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:02.921007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] PATH_INFO: `/v3/projects/11b9c10ea75d410a939075787dbd71fb` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:02.921007 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b9c10ea75d410a939075787dbd71fb)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:02.921465 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:02.928556 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:03.066862 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b9c10ea75d410a939075787dbd71fb', 'request_id': 'req-a557969d-3f88-4ce5-b68e-313c4486a326'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.136199 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b9c10ea75d410a939075787dbd71fb', 'request_id': 'req-a557969d-3f88-4ce5-b68e-313c4486a326'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.143639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b9c10ea75d410a939075787dbd71fb', 'request_id': 'req-a557969d-3f88-4ce5-b68e-313c4486a326'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.155159 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] The token cache is being invalidate because project 11b9c10ea75d410a939075787dbd71fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:03.155453 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.156134 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a557969d-3f88-4ce5-b68e-313c4486a326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.157639 dv-cinder-854267-1-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1450/2921] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:02 2022] DELETE /identity/v3/projects/11b9c10ea75d410a939075787dbd71fb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:12.558980 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:13.159393 dv-cinder-854267-1-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:33.730654 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:33.732097 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:33.874985 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8289-ca30-476e-b8d3-99d791814ccc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:33.935584 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62840e2e8fc94605a933c66f34dee30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bad5e705b204ad38b95921dcabe2557', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:33.936205 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:33.936487 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:33.936761 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:33.938511 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:33.950236 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:33.951867 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfd51d-ebf7-4029-b76a-b07b0ce6950f service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:33.961878 dv-cinder-854267-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1472/2922] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:57:43.957495 dv-cinder-854267-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}